2026-03-30 11:55:58 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:55:58 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:55:58 [auto1.fr] INFO: Batch mode enabled: batch 3/4
2026-03-30 11:55:58 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 11:55:58 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:55:58 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:55:58 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:55:58 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:55:58 [scrapy.extensions.telnet] INFO: Telnet Password: c498904bead2cbc4
2026-03-30 11:55:58 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:55:58 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_15_2026-03-30T11_10_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 11:55:58 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:55:58 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:55:58 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:55:58 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:55:58 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:55:58 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-30 11:55:58 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:58 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:55:58 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:55:58 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:55:58 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:55:58 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:55:58 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:55:58 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 11:55:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 11:55:58 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:55:58 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:56:30 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 5669 | hits on page: 40
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: XV65700
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: NV77157
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: EE45215
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: MH48249
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH48249%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.fr] INFO: Scrape type for MH48249: 1
2026-03-30 11:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: JV73062
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: DV39101
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: GG18860
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: VT14934
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT14934%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.fr] INFO: Scrape type for VT14934: 1
2026-03-30 11:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: HP90733
2026-03-30 11:56:30 [auto1.fr] INFO: Found listing with ID: GN63386
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN63386%27 HTTP/1.1" 200 None
2026-03-30 11:56:30 [auto1.fr] INFO: Scrape type for GN63386: 2
2026-03-30 11:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74004a68-81c2-50e4-b60b-bedf4042f941 with identifier: GN63386
2026-03-30 11:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74004a68-81c2-50e4-b60b-bedf4042f941 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74004a68-81c2-50e4-b60b-bedf4042f941 with scrape type 2
2026-03-30 11:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74004a68-81c2-50e4-b60b-bedf4042f941, identifier: GN63386
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74004a68-81c2-50e4-b60b-bedf4042f941 with identifier: GN63386
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:56:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74004a68-81c2-50e4-b60b-bedf4042f941 with identifier: GN63386
2026-03-30 11:56:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74004a68-81c2-50e4-b60b-bedf4042f941 with identifier: GN63386 to the API
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:34:38Z',
'fuel_type': 'diesel',
'id': '74004a68-81c2-50e4-b60b-bedf4042f941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN63386',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 268117,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN63386%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.fr] INFO: Saving data for GN63386: {'auction_closing_time': 1774971278.0, 'created_time': 1773078129.42546, 'last_price_update_time': 1774871791.745377}
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN63386') HTTP/1.1" 204 0
2026-03-30 11:56:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:31 [auto1.fr] INFO: Found listing with ID: CF56916
2026-03-30 11:56:31 [auto1.fr] INFO: Found listing with ID: CS41270
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS41270%27 HTTP/1.1" 200 None
2026-03-30 11:56:31 [auto1.fr] INFO: Scrape type for CS41270: 2
2026-03-30 11:56:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650e2406-ee8b-5ce6-9891-169594e73d11 with identifier: CS41270
2026-03-30 11:56:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650e2406-ee8b-5ce6-9891-169594e73d11 with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 650e2406-ee8b-5ce6-9891-169594e73d11 with scrape type 2
2026-03-30 11:56:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 650e2406-ee8b-5ce6-9891-169594e73d11, identifier: CS41270
2026-03-30 11:56:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 650e2406-ee8b-5ce6-9891-169594e73d11 with identifier: CS41270
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 650e2406-ee8b-5ce6-9891-169594e73d11 with identifier: CS41270
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 650e2406-ee8b-5ce6-9891-169594e73d11 with identifier: CS41270 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:34:54Z',
'fuel_type': 'diesel',
'id': '650e2406-ee8b-5ce6-9891-169594e73d11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS41270',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 104068,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-21',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 SE',
'transmission': 'automatic',
'trim': 'SE',
'year': 2016}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS41270%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.fr] INFO: Saving data for CS41270: {'auction_closing_time': 1774971294.0, 'created_time': 1774279331.099134, 'last_price_update_time': 1774871792.422235}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS41270') HTTP/1.1" 204 0
2026-03-30 11:56:32 [auto1.fr] INFO: Found listing with ID: XB55428
2026-03-30 11:56:32 [auto1.fr] INFO: Found listing with ID: KX25822
2026-03-30 11:56:32 [auto1.fr] INFO: Found listing with ID: HN35098
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN35098%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.fr] INFO: Scrape type for HN35098: 2
2026-03-30 11:56:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcb1a03-d844-5b01-9024-0c93846859db with identifier: HN35098
2026-03-30 11:56:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcb1a03-d844-5b01-9024-0c93846859db with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dcb1a03-d844-5b01-9024-0c93846859db with scrape type 2
2026-03-30 11:56:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7dcb1a03-d844-5b01-9024-0c93846859db, identifier: HN35098
2026-03-30 11:56:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7dcb1a03-d844-5b01-9024-0c93846859db with identifier: HN35098
2026-03-30 11:56:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7dcb1a03-d844-5b01-9024-0c93846859db with identifier: HN35098
2026-03-30 11:56:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7dcb1a03-d844-5b01-9024-0c93846859db with identifier: HN35098 to the API
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:03:44Z',
'fuel_type': 'diesel',
'id': '7dcb1a03-d844-5b01-9024-0c93846859db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN35098',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 108740,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-31',
'seller_name': None,
'title': 'BMW X1 sDrive 18d Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2016}
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN35098%27 HTTP/1.1" 200 None
2026-03-30 11:56:32 [auto1.fr] INFO: Saving data for HN35098: {'auction_closing_time': 1774969424.0, 'created_time': 1774279219.580149, 'last_price_update_time': 1774871792.993902}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HN35098') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: JZ08027
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: YU99322
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: UY44402
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: BE59418
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: TT82672
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT82672%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for TT82672: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a7388be-68b1-513b-b810-207e81c5dce4 with identifier: TT82672
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a7388be-68b1-513b-b810-207e81c5dce4 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a7388be-68b1-513b-b810-207e81c5dce4 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a7388be-68b1-513b-b810-207e81c5dce4, identifier: TT82672
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a7388be-68b1-513b-b810-207e81c5dce4 with identifier: TT82672
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a7388be-68b1-513b-b810-207e81c5dce4 with identifier: TT82672
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4a7388be-68b1-513b-b810-207e81c5dce4 with identifier: TT82672 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:30:16Z',
'fuel_type': 'diesel',
'id': '4a7388be-68b1-513b-b810-207e81c5dce4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT82672',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 134150,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sky 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sky 4Motion BlueMotion Tech',
'year': 2015}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT82672%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Saving data for TT82672: {'auction_closing_time': 1774971016.0, 'created_time': 1774266911.784545, 'last_price_update_time': 1774871793.478551}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TT82672') HTTP/1.1" 204 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: YB17144
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB17144%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for YB17144: 0
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: KM22406
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: VA21419
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: UA52585
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: DN00368
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: KV64764
2026-03-30 11:56:33 [auto1.fr] INFO: Found listing with ID: FA77085
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA77085%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Scrape type for FA77085: 2
2026-03-30 11:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945d6756-a6c1-59d5-96c1-323be7cb7819 with identifier: FA77085
2026-03-30 11:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945d6756-a6c1-59d5-96c1-323be7cb7819 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945d6756-a6c1-59d5-96c1-323be7cb7819 with scrape type 2
2026-03-30 11:56:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 945d6756-a6c1-59d5-96c1-323be7cb7819, identifier: FA77085
2026-03-30 11:56:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 945d6756-a6c1-59d5-96c1-323be7cb7819 with identifier: FA77085
2026-03-30 11:56:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 945d6756-a6c1-59d5-96c1-323be7cb7819 with identifier: FA77085
2026-03-30 11:56:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 945d6756-a6c1-59d5-96c1-323be7cb7819 with identifier: FA77085 to the API
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:24:38Z',
'fuel_type': 'diesel',
'id': '945d6756-a6c1-59d5-96c1-323be7cb7819',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA77085',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 127627,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2016}
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA77085%27 HTTP/1.1" 200 None
2026-03-30 11:56:33 [auto1.fr] INFO: Saving data for FA77085: {'auction_closing_time': 1774970678.0, 'created_time': 1773295282.101082, 'last_price_update_time': 1774871793.993004}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA77085') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: GM72216
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: NJ73024
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: PB73198
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: JU43458
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: WV43815
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV43815%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for WV43815: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with identifier: WV43815
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8906318f-d7dc-56b9-b6c3-69303aaae1e3, identifier: WV43815
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with identifier: WV43815
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with identifier: WV43815
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8906318f-d7dc-56b9-b6c3-69303aaae1e3 with identifier: WV43815 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:22:23Z',
'fuel_type': 'diesel',
'id': '8906318f-d7dc-56b9-b6c3-69303aaae1e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV43815',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 189781,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-18',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2016}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV43815%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Saving data for WV43815: {'auction_closing_time': 1774970543.0, 'created_time': 1773692615.808599, 'last_price_update_time': 1774871794.736368}
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV43815') HTTP/1.1" 204 0
2026-03-30 11:56:34 [auto1.fr] INFO: Found listing with ID: NP11581
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP11581%27 HTTP/1.1" 200 None
2026-03-30 11:56:34 [auto1.fr] INFO: Scrape type for NP11581: 2
2026-03-30 11:56:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a26abedc-124f-5dcf-8691-dcc8c966689a with identifier: NP11581
2026-03-30 11:56:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a26abedc-124f-5dcf-8691-dcc8c966689a with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a26abedc-124f-5dcf-8691-dcc8c966689a with scrape type 2
2026-03-30 11:56:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a26abedc-124f-5dcf-8691-dcc8c966689a, identifier: NP11581
2026-03-30 11:56:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a26abedc-124f-5dcf-8691-dcc8c966689a with identifier: NP11581
2026-03-30 11:56:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a26abedc-124f-5dcf-8691-dcc8c966689a with identifier: NP11581
2026-03-30 11:56:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a26abedc-124f-5dcf-8691-dcc8c966689a with identifier: NP11581 to the API
2026-03-30 11:56:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:13:59Z',
'fuel_type': 'diesel',
'id': 'a26abedc-124f-5dcf-8691-dcc8c966689a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP11581',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 179274,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-19',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP11581%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Saving data for NP11581: {'auction_closing_time': 1774970039.0, 'created_time': 1772616304.302537, 'last_price_update_time': 1774871795.229637}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP11581') HTTP/1.1" 204 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: RX18244
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: VK19723
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: LW71513
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW71513%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for LW71513: 1
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: UY27406
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: GG75036
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG75036%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for GG75036: 2
2026-03-30 11:56:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417a9253-653b-558f-b026-8f2f6a18b9c9 with identifier: GG75036
2026-03-30 11:56:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417a9253-653b-558f-b026-8f2f6a18b9c9 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 417a9253-653b-558f-b026-8f2f6a18b9c9 with scrape type 2
2026-03-30 11:56:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 417a9253-653b-558f-b026-8f2f6a18b9c9, identifier: GG75036
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 417a9253-653b-558f-b026-8f2f6a18b9c9 with identifier: GG75036
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:56:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 417a9253-653b-558f-b026-8f2f6a18b9c9 with identifier: GG75036
2026-03-30 11:56:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 417a9253-653b-558f-b026-8f2f6a18b9c9 with identifier: GG75036 to the API
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:34:58Z',
'fuel_type': 'petrol',
'id': '417a9253-653b-558f-b026-8f2f6a18b9c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG75036',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 103251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-12',
'seller_name': None,
'title': 'Peugeot 308 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG75036%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Saving data for GG75036: {'auction_closing_time': 1774971298.0, 'created_time': 1772614636.219963, 'last_price_update_time': 1774871795.980152}
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG75036') HTTP/1.1" 204 0
2026-03-30 11:56:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: VJ94482
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: LM69202
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM69202%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for LM69202: 2
2026-03-30 11:56:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with identifier: LM69202
2026-03-30 11:56:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with scrape type 2
2026-03-30 11:56:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0, identifier: LM69202
2026-03-30 11:56:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with identifier: LM69202
2026-03-30 11:56:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with identifier: LM69202
2026-03-30 11:56:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0 with identifier: LM69202 to the API
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:56:27Z',
'fuel_type': 'diesel',
'id': '2dd4cc98-6def-5b66-b6e2-2af30a2b4bb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM69202',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 246724,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-15',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2013}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM69202%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Saving data for LM69202: {'auction_closing_time': 1774972587.0, 'created_time': 1774253461.577346, 'last_price_update_time': 1774871796.565977}
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM69202') HTTP/1.1" 204 0
2026-03-30 11:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:36 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: MM08238
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: XV65700
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: NV77157
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: EE45215
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: MH48249
2026-03-30 11:56:36 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/MH48249/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:56:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: JV73062
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: DV39101
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: GG18860
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: VT14934
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: HP90733
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: GN63386
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN63386%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for GN63386: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: CF56916
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: CS41270
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS41270%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for CS41270: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: XB55428
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: KX25822
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: HN35098
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN35098%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for HN35098: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: JZ08027
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: YU99322
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: UY44402
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: BE59418
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: TT82672
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT82672%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for TT82672: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: YB17144
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB17144%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for YB17144: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: KM22406
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: VA21419
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: UA52585
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: DN00368
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: KV64764
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: FA77085
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA77085%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for FA77085: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: GM72216
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: NJ73024
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: PB73198
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: JU43458
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: WV43815
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV43815%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for WV43815: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: NP11581
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP11581%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for NP11581: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: RX18244
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: VK19723
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: LW71513
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: UY27406
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: GG75036
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG75036%27 HTTP/1.1" 200 None
2026-03-30 11:56:36 [auto1.fr] INFO: Scrape type for GG75036: 0
2026-03-30 11:56:36 [auto1.fr] INFO: Found listing with ID: VJ94482
2026-03-30 11:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH48249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:45 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: LM69202
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM69202%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for LM69202: 0
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: GR68015
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR68015%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for GR68015: 1
2026-03-30 11:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: MZ47955
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: LR41287
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: DB07051
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: BJ74414
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: AT75907
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: MG77524
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: FY00408
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY00408%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for FY00408: 1
2026-03-30 11:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: PR62918
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR62918%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for PR62918: 1
2026-03-30 11:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: SD54600
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: TY98039
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY98039%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for TY98039: 1
2026-03-30 11:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: HW61019
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: ZN19344
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN19344%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for ZN19344: 2
2026-03-30 11:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-03-30 11:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756, identifier: ZN19344
2026-03-30 11:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-03-30 11:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344
2026-03-30 11:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13d3758f-f7dd-5b5f-a4c5-13dede0a4756 with identifier: ZN19344 to the API
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:05:46Z',
'fuel_type': 'diesel',
'id': '13d3758f-f7dd-5b5f-a4c5-13dede0a4756',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN19344',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 213344,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-29',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2007}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN19344%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Saving data for ZN19344: {'auction_closing_time': 1774969546.0, 'created_time': 1773662502.106731, 'last_price_update_time': 1774871805.571845}
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN19344') HTTP/1.1" 204 0
2026-03-30 11:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: NY07201
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: VX26854
2026-03-30 11:56:45 [auto1.fr] INFO: Found listing with ID: PN57067
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN57067%27 HTTP/1.1" 200 None
2026-03-30 11:56:45 [auto1.fr] INFO: Scrape type for PN57067: 2
2026-03-30 11:56:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64adcd84-27e0-5b2d-8220-81be987bdd54 with identifier: PN57067
2026-03-30 11:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64adcd84-27e0-5b2d-8220-81be987bdd54 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64adcd84-27e0-5b2d-8220-81be987bdd54 with scrape type 2
2026-03-30 11:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64adcd84-27e0-5b2d-8220-81be987bdd54, identifier: PN57067
2026-03-30 11:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64adcd84-27e0-5b2d-8220-81be987bdd54 with identifier: PN57067
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:56:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64adcd84-27e0-5b2d-8220-81be987bdd54 with identifier: PN57067
2026-03-30 11:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64adcd84-27e0-5b2d-8220-81be987bdd54 with identifier: PN57067 to the API
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:13:20Z',
'fuel_type': 'diesel',
'id': '64adcd84-27e0-5b2d-8220-81be987bdd54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN57067',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 135266,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-04',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2019}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN57067%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Saving data for PN57067: {'auction_closing_time': 1774970000.0, 'created_time': 1773411491.612153, 'last_price_update_time': 1774871806.244232}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PN57067') HTTP/1.1" 204 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: YZ78520
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: SC42808
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: GM24607
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BU38930
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU38930%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for BU38930: 1
2026-03-30 11:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH48249> (referer: https://www.auto1.com/v1/car-details-view/MH48249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: UN25144
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN25144%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for UN25144: 1
2026-03-30 11:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: EF08493
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: HL55412
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL55412%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for HL55412: 2
2026-03-30 11:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001de33d-63fe-52e8-86f8-256bd8211e3c with identifier: HL55412
2026-03-30 11:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001de33d-63fe-52e8-86f8-256bd8211e3c with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 001de33d-63fe-52e8-86f8-256bd8211e3c with scrape type 2
2026-03-30 11:56:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 001de33d-63fe-52e8-86f8-256bd8211e3c, identifier: HL55412
2026-03-30 11:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 001de33d-63fe-52e8-86f8-256bd8211e3c with identifier: HL55412
2026-03-30 11:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 001de33d-63fe-52e8-86f8-256bd8211e3c with identifier: HL55412
2026-03-30 11:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 001de33d-63fe-52e8-86f8-256bd8211e3c with identifier: HL55412 to the API
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:13:17Z',
'fuel_type': 'petrol',
'id': '001de33d-63fe-52e8-86f8-256bd8211e3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL55412',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 143430,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-17',
'seller_name': None,
'title': 'BMW 3er 320i Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2013}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL55412%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Saving data for HL55412: {'auction_closing_time': 1774969997.0, 'created_time': 1774452475.136886, 'last_price_update_time': 1774871806.755826}
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL55412') HTTP/1.1" 204 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: ZV36898
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BU59863
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: JM33672
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: JU85773
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: LF30369
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CB66110
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: WG48740
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG48740%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for WG48740: 1
2026-03-30 11:56:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 811f8721-6c58-5b44-82d0-304c48600347 with identifier: MH48249
2026-03-30 11:56:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 811f8721-6c58-5b44-82d0-304c48600347 with scrape type 1
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 811f8721-6c58-5b44-82d0-304c48600347
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_45c13d817c5d211e27a86b4832c4f0f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_45c13d817c5d211e27a86b4832c4f0f3.jpg already downloaded
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_56598fd23010ae201c0cf72bc80081c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_56598fd23010ae201c0cf72bc80081c1.jpg already downloaded
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_f67696d6c5deeee4f130b1cd483e3213.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_f67696d6c5deeee4f130b1cd483e3213.jpg already downloaded
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_855b55839c89aa21f491de48296a71e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_855b55839c89aa21f491de48296a71e6.jpg already downloaded
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_2e8fd8f8cad21499132ffa23b820f016.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_2e8fd8f8cad21499132ffa23b820f016.jpg already downloaded
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F9d%252Ffc9d5507dc3078c6cde3bd1d2acf44f3%252Fpa%252FMH48249_b7e9eae5ffeb6c65cc775358b1c71977.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_b7e9eae5ffeb6c65cc775358b1c71977.jpg already downloaded
2026-03-30 11:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 811f8721-6c58-5b44-82d0-304c48600347, identifier: MH48249
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: KS78831
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: LU19709
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU19709%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.fr] INFO: Scrape type for LU19709: 2
2026-03-30 11:56:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with identifier: LU19709
2026-03-30 11:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with scrape type 2
2026-03-30 11:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c62d67b5-d0cd-5ef8-b386-6baec72e9ab4, identifier: LU19709
2026-03-30 11:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 811f8721-6c58-5b44-82d0-304c48600347 with identifier: MH48249
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:56:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 811f8721-6c58-5b44-82d0-304c48600347 with identifier: MH48249
2026-03-30 11:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 811f8721-6c58-5b44-82d0-304c48600347 with identifier: MH48249 to the API
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH48249>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:03:14Z',
'fuel_type': 'diesel',
'id': '811f8721-6c58-5b44-82d0-304c48600347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH48249',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '308',
'odometer': 200734,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_45c13d817c5d211e27a86b4832c4f0f3.jpg',
'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_56598fd23010ae201c0cf72bc80081c1.jpg',
'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_f67696d6c5deeee4f130b1cd483e3213.jpg',
'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_855b55839c89aa21f491de48296a71e6.jpg',
'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_2e8fd8f8cad21499132ffa23b820f016.jpg',
'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_b7e9eae5ffeb6c65cc775358b1c71977.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_45c13d817c5d211e27a86b4832c4f0f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_56598fd23010ae201c0cf72bc80081c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_f67696d6c5deeee4f130b1cd483e3213.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_855b55839c89aa21f491de48296a71e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_2e8fd8f8cad21499132ffa23b820f016.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811f8721-6c58-5b44-82d0-304c48600347/811f8721-6c58-5b44-82d0-304c48600347_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/9d/fc9d5507dc3078c6cde3bd1d2acf44f3/pa/MH48249_b7e9eae5ffeb6c65cc775358b1c71977.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2012}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH48249%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.fr] INFO: Saving data for MH48249: {'created_time': 1774871807.626482, 'last_price_update_time': 1774871807.626494, 'auction_closing_time': 1774969394.0}
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MH48249') HTTP/1.1" 204 0
2026-03-30 11:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with identifier: LU19709
2026-03-30 11:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with identifier: LU19709
2026-03-30 11:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c62d67b5-d0cd-5ef8-b386-6baec72e9ab4 with identifier: LU19709 to the API
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:57:29Z',
'fuel_type': 'diesel',
'id': 'c62d67b5-d0cd-5ef8-b386-6baec72e9ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU19709',
'listing': 'auction',
'make': 'Renault',
'model': 'Laguna',
'odometer': 165954,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-24',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2013}
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU19709%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Saving data for LU19709: {'auction_closing_time': 1774972649.0, 'created_time': 1773692022.525463, 'last_price_update_time': 1774871808.114248}
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LU19709') HTTP/1.1" 204 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: UY99248
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: FP86995
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: EJ67519
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: YE22009
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE22009%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for YE22009: 2
2026-03-30 11:56:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with identifier: YE22009
2026-03-30 11:56:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with scrape type 2
2026-03-30 11:56:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with scrape type 2
2026-03-30 11:56:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385, identifier: YE22009
2026-03-30 11:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY98039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with identifier: YE22009
2026-03-30 11:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with identifier: YE22009
2026-03-30 11:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 04d1e4ad-8f69-52c9-8f0e-ce4f91bed385 with identifier: YE22009 to the API
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:40:28Z',
'fuel_type': 'diesel',
'id': '04d1e4ad-8f69-52c9-8f0e-ce4f91bed385',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE22009',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 126778,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-11',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE22009%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Saving data for YE22009: {'auction_closing_time': 1774971628.0, 'created_time': 1774267026.755302, 'last_price_update_time': 1774871808.57054}
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YE22009') HTTP/1.1" 204 0
2026-03-30 11:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: TR82723
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR82723%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for TR82723: 1
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: XR62682
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR62682%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for XR62682: 1
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: VE95693
2026-03-30 11:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY00408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU38930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT14934/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW71513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG48740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY00408> (referer: https://www.auto1.com/v1/car-details-view/FY00408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24913063-7b8c-5ae9-9d60-9fb42f99ae57 with identifier: FY00408
2026-03-30 11:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24913063-7b8c-5ae9-9d60-9fb42f99ae57 with scrape type 1
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24913063-7b8c-5ae9-9d60-9fb42f99ae57
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_82d85059efbde1ea3b297033d9cfb3be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_82d85059efbde1ea3b297033d9cfb3be.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_78f1814cfbcf10cf38551ea9c5ffa165.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_78f1814cfbcf10cf38551ea9c5ffa165.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_8fb5894b207358b49d07dd6cb4c49f6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_8fb5894b207358b49d07dd6cb4c49f6f.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_d26b669ce19d64c465298dbe47104220.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_d26b669ce19d64c465298dbe47104220.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_453961909345d33a1d44a65f31842544.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_453961909345d33a1d44a65f31842544.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_aff14ea5ad1e643515a27a3d69d351bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_aff14ea5ad1e643515a27a3d69d351bf.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_75f2c0bc7598ed44daca43f02a72ffff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_75f2c0bc7598ed44daca43f02a72ffff.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_49829679d8cd10037300cbf4eeb1adda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_49829679d8cd10037300cbf4eeb1adda.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_87b41a467912183ac2b88ac4d3ce5b62.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_87b41a467912183ac2b88ac4d3ce5b62.jpg already downloaded
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F55%252F5d555e0fdbdbdddfefc23131d8822179%252Fpa%252FFY00408_004ea327cd59ec645d92813465010c2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_004ea327cd59ec645d92813465010c2d.jpg already downloaded
2026-03-30 11:56:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24913063-7b8c-5ae9-9d60-9fb42f99ae57, identifier: FY00408
2026-03-30 11:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24913063-7b8c-5ae9-9d60-9fb42f99ae57 with identifier: FY00408
2026-03-30 11:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24913063-7b8c-5ae9-9d60-9fb42f99ae57 with identifier: FY00408
2026-03-30 11:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24913063-7b8c-5ae9-9d60-9fb42f99ae57 with identifier: FY00408 to the API
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FY00408>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:04:19Z',
'fuel_type': 'diesel',
'id': '24913063-7b8c-5ae9-9d60-9fb42f99ae57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY00408',
'listing': 'auction',
'location': 'FR, Manosque',
'make': 'Ford',
'model': 'Kuga',
'odometer': 200519,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_82d85059efbde1ea3b297033d9cfb3be.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_78f1814cfbcf10cf38551ea9c5ffa165.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_8fb5894b207358b49d07dd6cb4c49f6f.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_d26b669ce19d64c465298dbe47104220.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_453961909345d33a1d44a65f31842544.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_aff14ea5ad1e643515a27a3d69d351bf.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_75f2c0bc7598ed44daca43f02a72ffff.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_49829679d8cd10037300cbf4eeb1adda.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_87b41a467912183ac2b88ac4d3ce5b62.jpg',
'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_004ea327cd59ec645d92813465010c2d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_82d85059efbde1ea3b297033d9cfb3be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_78f1814cfbcf10cf38551ea9c5ffa165.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_8fb5894b207358b49d07dd6cb4c49f6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_d26b669ce19d64c465298dbe47104220.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_453961909345d33a1d44a65f31842544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_aff14ea5ad1e643515a27a3d69d351bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_75f2c0bc7598ed44daca43f02a72ffff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_49829679d8cd10037300cbf4eeb1adda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_87b41a467912183ac2b88ac4d3ce5b62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24913063-7b8c-5ae9-9d60-9fb42f99ae57/24913063-7b8c-5ae9-9d60-9fb42f99ae57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/55/5d555e0fdbdbdddfefc23131d8822179/pa/FY00408_004ea327cd59ec645d92813465010c2d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Sport Platinium',
'transmission': 'automatic',
'trim': 'Sport Platinium',
'year': 2013}
2026-03-30 11:56:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY00408%27 HTTP/1.1" 200 None
2026-03-30 11:56:56 [auto1.fr] INFO: Saving data for FY00408: {'created_time': 1774871816.00301, 'last_price_update_time': 1774871816.003024, 'auction_closing_time': 1774969459.0}
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FY00408') HTTP/1.1" 204 0
2026-03-30 11:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU38930> (referer: https://www.auto1.com/v1/car-details-view/BU38930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7552629a-4d4f-565f-a2ab-d2f71956bd02 with identifier: BU38930
2026-03-30 11:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7552629a-4d4f-565f-a2ab-d2f71956bd02 with scrape type 1
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7552629a-4d4f-565f-a2ab-d2f71956bd02
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_02b7018f3925b4ff37082c23dc97e6ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_02b7018f3925b4ff37082c23dc97e6ee.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_ea3e932b51f5ac9321b02e3f259ba2ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ea3e932b51f5ac9321b02e3f259ba2ae.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_ba0d1f090663c9e42ddc5515a750a395.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ba0d1f090663c9e42ddc5515a750a395.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_3d634ab49de353de4c775f5038e9f91c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_3d634ab49de353de4c775f5038e9f91c.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_37d6c98790a9c72594a6c7e199b04308.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_37d6c98790a9c72594a6c7e199b04308.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_f687f9fea18d008dd780865419d6a83c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_f687f9fea18d008dd780865419d6a83c.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_5fc05c62c5d662f6fc80ee28fae364f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_5fc05c62c5d662f6fc80ee28fae364f3.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_0c501b985e06ff3ea048f4afc261e2c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_0c501b985e06ff3ea048f4afc261e2c2.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_1e6a3b51b207d75a8dac4e8e94699d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_1e6a3b51b207d75a8dac4e8e94699d44.jpg already downloaded
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F13%252Fff1364e8045cd153b87586606e8535d9%252Fpa%252FBU38930_05a5fc8ef2e8f659932f0d8c3ff71ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_05a5fc8ef2e8f659932f0d8c3ff71ce3.jpg already downloaded
2026-03-30 11:56:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7552629a-4d4f-565f-a2ab-d2f71956bd02, identifier: BU38930
2026-03-30 11:56:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7552629a-4d4f-565f-a2ab-d2f71956bd02 with identifier: BU38930
2026-03-30 11:56:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7552629a-4d4f-565f-a2ab-d2f71956bd02 with identifier: BU38930
2026-03-30 11:56:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7552629a-4d4f-565f-a2ab-d2f71956bd02 with identifier: BU38930 to the API
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU38930>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.6L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:15:37Z',
'fuel_type': 'diesel',
'id': '7552629a-4d4f-565f-a2ab-d2f71956bd02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU38930',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 145870,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_02b7018f3925b4ff37082c23dc97e6ee.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ea3e932b51f5ac9321b02e3f259ba2ae.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ba0d1f090663c9e42ddc5515a750a395.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_3d634ab49de353de4c775f5038e9f91c.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_37d6c98790a9c72594a6c7e199b04308.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_f687f9fea18d008dd780865419d6a83c.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_5fc05c62c5d662f6fc80ee28fae364f3.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_0c501b985e06ff3ea048f4afc261e2c2.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_1e6a3b51b207d75a8dac4e8e94699d44.jpg',
'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_05a5fc8ef2e8f659932f0d8c3ff71ce3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_02b7018f3925b4ff37082c23dc97e6ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ea3e932b51f5ac9321b02e3f259ba2ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_ba0d1f090663c9e42ddc5515a750a395.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_3d634ab49de353de4c775f5038e9f91c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_37d6c98790a9c72594a6c7e199b04308.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_f687f9fea18d008dd780865419d6a83c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_5fc05c62c5d662f6fc80ee28fae364f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_0c501b985e06ff3ea048f4afc261e2c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_1e6a3b51b207d75a8dac4e8e94699d44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7552629a-4d4f-565f-a2ab-d2f71956bd02/7552629a-4d4f-565f-a2ab-d2f71956bd02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/13/ff1364e8045cd153b87586606e8535d9/pa/BU38930_05a5fc8ef2e8f659932f0d8c3ff71ce3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.6 CRDi Mild-Hybrid Creative 2WD',
'transmission': 'automatic',
'trim': 'Creative 2WD',
'year': 2021}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU38930%27 HTTP/1.1" 200 None
2026-03-30 11:56:57 [auto1.fr] INFO: Saving data for BU38930: {'created_time': 1774871817.666536, 'last_price_update_time': 1774871817.666547, 'auction_closing_time': 1774970137.0}
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU38930') HTTP/1.1" 204 0
2026-03-30 11:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN25144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:58 [scrapy.extensions.logstats] INFO: Crawled 17 pages (at 17 pages/min), scraped 17 items (at 17 items/min)
2026-03-30 11:56:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 11:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW71513> (referer: https://www.auto1.com/v1/car-details-view/LW71513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ccb3cc1-066f-59c9-bb3d-817f71acf834 with identifier: LW71513
2026-03-30 11:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccb3cc1-066f-59c9-bb3d-817f71acf834 with scrape type 1
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ccb3cc1-066f-59c9-bb3d-817f71acf834
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_8963d6c718bd7180d8a12403d363ef53.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_8963d6c718bd7180d8a12403d363ef53.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_ad4a015e08e8497f767235c7f14512fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_ad4a015e08e8497f767235c7f14512fe.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_60f61914f0d635dc284087fb30bfefe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_60f61914f0d635dc284087fb30bfefe7.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_cb380c7cc19a1f52593a3a8c42e452a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_cb380c7cc19a1f52593a3a8c42e452a9.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_1ca1cbb8fa9de1e6fc09d71a9f0b1ac1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1ca1cbb8fa9de1e6fc09d71a9f0b1ac1.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_6949ba99d634120fcd2cf442db4ab2bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_6949ba99d634120fcd2cf442db4ab2bc.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_4176ae3c60c6d78023ec10f0b9aca7cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_4176ae3c60c6d78023ec10f0b9aca7cc.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_5d678883e57850403b88921b0f709765.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_5d678883e57850403b88921b0f709765.jpg already downloaded
2026-03-30 11:56:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_c01c1c069830dfe8e6d10f30ad16f91d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_c01c1c069830dfe8e6d10f30ad16f91d.jpg already downloaded
2026-03-30 11:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F55%252F4b553bd29a7ca98cb9c3a6c351276aa8%252Fpa%252FLW71513_1c46437ffb99c4c515e58b4aabf3004c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1c46437ffb99c4c515e58b4aabf3004c.jpg already downloaded
2026-03-30 11:57:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ccb3cc1-066f-59c9-bb3d-817f71acf834, identifier: LW71513
2026-03-30 11:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ccb3cc1-066f-59c9-bb3d-817f71acf834 with identifier: LW71513
2026-03-30 11:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ccb3cc1-066f-59c9-bb3d-817f71acf834 with identifier: LW71513
2026-03-30 11:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ccb3cc1-066f-59c9-bb3d-817f71acf834 with identifier: LW71513 to the API
2026-03-30 11:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW71513>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:24:51Z',
'fuel_type': 'diesel',
'id': '3ccb3cc1-066f-59c9-bb3d-817f71acf834',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW71513',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 223163,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_8963d6c718bd7180d8a12403d363ef53.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_ad4a015e08e8497f767235c7f14512fe.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_60f61914f0d635dc284087fb30bfefe7.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_cb380c7cc19a1f52593a3a8c42e452a9.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1ca1cbb8fa9de1e6fc09d71a9f0b1ac1.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_6949ba99d634120fcd2cf442db4ab2bc.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_4176ae3c60c6d78023ec10f0b9aca7cc.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_5d678883e57850403b88921b0f709765.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_c01c1c069830dfe8e6d10f30ad16f91d.jpg',
'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1c46437ffb99c4c515e58b4aabf3004c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2632178,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_8963d6c718bd7180d8a12403d363ef53.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_ad4a015e08e8497f767235c7f14512fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_60f61914f0d635dc284087fb30bfefe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_cb380c7cc19a1f52593a3a8c42e452a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1ca1cbb8fa9de1e6fc09d71a9f0b1ac1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_6949ba99d634120fcd2cf442db4ab2bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3008175,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_4176ae3c60c6d78023ec10f0b9aca7cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2966234,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_5d678883e57850403b88921b0f709765.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_c01c1c069830dfe8e6d10f30ad16f91d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ccb3cc1-066f-59c9-bb3d-817f71acf834/3ccb3cc1-066f-59c9-bb3d-817f71acf834_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/55/4b553bd29a7ca98cb9c3a6c351276aa8/pa/LW71513_1c46437ffb99c4c515e58b4aabf3004c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Carat BlueMotion',
'transmission': 'automatic',
'trim': 'Carat BlueMotion',
'year': 2015}
2026-03-30 11:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW71513%27 HTTP/1.1" 200 None
2026-03-30 11:57:06 [auto1.fr] INFO: Saving data for LW71513: {'created_time': 1774871826.481372, 'last_price_update_time': 1774871826.481382, 'auction_closing_time': 1774970691.0}
2026-03-30 11:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW71513') HTTP/1.1" 204 0
2026-03-30 11:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR62682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR62918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT14934> (referer: https://www.auto1.com/v1/car-details-view/VT14934/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b7d02f-7df8-5f06-8b82-92e4387f59b8 with identifier: VT14934
2026-03-30 11:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b7d02f-7df8-5f06-8b82-92e4387f59b8 with scrape type 1
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 24b7d02f-7df8-5f06-8b82-92e4387f59b8
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_633a6232d243e1657d86824b5af7ec16.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_633a6232d243e1657d86824b5af7ec16.jpg already downloaded
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_b2142fc75a53ba05581675cc041cb5f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_b2142fc75a53ba05581675cc041cb5f7.jpg already downloaded
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_702e7fc52f5e5cd5aca8c2860b83c45a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_702e7fc52f5e5cd5aca8c2860b83c45a.jpg already downloaded
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_a698b010b0f830f46a61de87163e3322.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_a698b010b0f830f46a61de87163e3322.jpg already downloaded
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_3b33d683f170dbf84a99f375f334ffbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_3b33d683f170dbf84a99f375f334ffbf.jpg already downloaded
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F81%252F3a81aeeeb37e1abccfab27a9f336a1b0%252Fpa%252FVT14934_bc8d1d5f7fea86067ad12a38b14ce3d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_bc8d1d5f7fea86067ad12a38b14ce3d0.jpg already downloaded
2026-03-30 11:57:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24b7d02f-7df8-5f06-8b82-92e4387f59b8, identifier: VT14934
2026-03-30 11:57:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24b7d02f-7df8-5f06-8b82-92e4387f59b8 with identifier: VT14934
2026-03-30 11:57:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24b7d02f-7df8-5f06-8b82-92e4387f59b8 with identifier: VT14934
2026-03-30 11:57:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24b7d02f-7df8-5f06-8b82-92e4387f59b8 with identifier: VT14934 to the API
2026-03-30 11:57:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT14934>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 88,
'expiration_date': '2026-03-31T15:54:33Z',
'fuel_type': 'petrol',
'id': '24b7d02f-7df8-5f06-8b82-92e4387f59b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT14934',
'listing': 'auction',
'location': 'Saint Herblain',
'make': 'Nissan',
'model': 'Note',
'odometer': 222640,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_633a6232d243e1657d86824b5af7ec16.jpg',
'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_b2142fc75a53ba05581675cc041cb5f7.jpg',
'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_702e7fc52f5e5cd5aca8c2860b83c45a.jpg',
'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_a698b010b0f830f46a61de87163e3322.jpg',
'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_3b33d683f170dbf84a99f375f334ffbf.jpg',
'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_bc8d1d5f7fea86067ad12a38b14ce3d0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_633a6232d243e1657d86824b5af7ec16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_b2142fc75a53ba05581675cc041cb5f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_702e7fc52f5e5cd5aca8c2860b83c45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_a698b010b0f830f46a61de87163e3322.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_3b33d683f170dbf84a99f375f334ffbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b7d02f-7df8-5f06-8b82-92e4387f59b8/24b7d02f-7df8-5f06-8b82-92e4387f59b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/81/3a81aeeeb37e1abccfab27a9f336a1b0/pa/VT14934_bc8d1d5f7fea86067ad12a38b14ce3d0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Note 1.4 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2010}
2026-03-30 11:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT14934%27 HTTP/1.1" 200 None
2026-03-30 11:57:14 [auto1.fr] INFO: Saving data for VT14934: {'created_time': 1774871834.930495, 'last_price_update_time': 1774871834.930506, 'auction_closing_time': 1774972473.0}
2026-03-30 11:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VT14934') HTTP/1.1" 204 0
2026-03-30 11:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG48740> (referer: https://www.auto1.com/v1/car-details-view/WG48740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with identifier: WG48740
2026-03-30 11:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with scrape type 1
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_799818565d5680f77b1e6d5e021a8aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_799818565d5680f77b1e6d5e021a8aa9.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_b5cb71712785eacdf2162aba07c81867.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_b5cb71712785eacdf2162aba07c81867.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_7ce1e512244e44b2136524a368770182.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_7ce1e512244e44b2136524a368770182.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_3775133c878dfdeefc9a520dd24ece45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_3775133c878dfdeefc9a520dd24ece45.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_4651a8faa3a91ed6627bfebfb523c526.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_4651a8faa3a91ed6627bfebfb523c526.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_f401e22f749b83c315614bec769ffda7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f401e22f749b83c315614bec769ffda7.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_f819583eefd2a6a727bdbc1356e28640.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f819583eefd2a6a727bdbc1356e28640.jpg not downloaded yet
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_37c187b696777e7ae234dea0d93fdb1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_37c187b696777e7ae234dea0d93fdb1d.jpg not downloaded yet
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_799818565d5680f77b1e6d5e021a8aa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_7ce1e512244e44b2136524a368770182.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_3775133c878dfdeefc9a520dd24ece45.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_b5cb71712785eacdf2162aba07c81867.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_4651a8faa3a91ed6627bfebfb523c526.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f819583eefd2a6a727bdbc1356e28640.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f401e22f749b83c315614bec769ffda7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_37c187b696777e7ae234dea0d93fdb1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859e5ed0>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_799818565d5680f77b1e6d5e021a8aa9.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_799818565d5680f77b1e6d5e021a8aa9.jpg saved to cache
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a01910>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_7ce1e512244e44b2136524a368770182.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_7ce1e512244e44b2136524a368770182.jpg saved to cache
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0e690>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_3775133c878dfdeefc9a520dd24ece45.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_3775133c878dfdeefc9a520dd24ece45.jpg saved to cache
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512dbd0>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_b5cb71712785eacdf2162aba07c81867.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_b5cb71712785eacdf2162aba07c81867.jpg saved to cache
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513e410>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_4651a8faa3a91ed6627bfebfb523c526.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_4651a8faa3a91ed6627bfebfb523c526.jpg saved to cache
2026-03-30 11:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513eb10>
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_f819583eefd2a6a727bdbc1356e28640.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f819583eefd2a6a727bdbc1356e28640.jpg saved to cache
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285134390>
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_f401e22f749b83c315614bec769ffda7.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f401e22f749b83c315614bec769ffda7.jpg saved to cache
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285151290>
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg saved to cache
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514d5d0>
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_37c187b696777e7ae234dea0d93fdb1d.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_37c187b696777e7ae234dea0d93fdb1d.jpg saved to cache
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR62682> (referer: https://www.auto1.com/v1/car-details-view/XR62682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR62918> (referer: https://www.auto1.com/v1/car-details-view/PR62918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850bef90>
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F4d%252F954d8e9f94191aeb3662bdabf813e083%252Fpa%252FWG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg saved to cache
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d
2026-03-30 11:57:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d, skipping ID generation
2026-03-30 11:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with scrape type 1
2026-03-30 11:57:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d sending to next pipeline
2026-03-30 11:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d, identifier: WG48740
2026-03-30 11:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with identifier: WG48740
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:57:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with identifier: WG48740
2026-03-30 11:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d with identifier: WG48740 to the API
2026-03-30 11:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2026-03-31T15:49:01Z',
'fuel_type': 'hybrid',
'id': '5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG48740',
'listing': 'auction',
'location': 'FR',
'make': 'Kia',
'model': 'Sportage',
'odometer': 183134,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_799818565d5680f77b1e6d5e021a8aa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_b5cb71712785eacdf2162aba07c81867.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_7ce1e512244e44b2136524a368770182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_3775133c878dfdeefc9a520dd24ece45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_54a016cb13007adf0eab5d1c163e4ae3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_4651a8faa3a91ed6627bfebfb523c526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_bd6028a58b1f0d56c361ef7d77bc2fc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f401e22f749b83c315614bec769ffda7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_f819583eefd2a6a727bdbc1356e28640.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d/5a0c9d69-a5c7-5ab4-8150-8fc7b2ad937d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/4d/954d8e9f94191aeb3662bdabf813e083/pa/WG48740_37c187b696777e7ae234dea0d93fdb1d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line Premium',
'transmission': 'automatic',
'trim': 'GT-Line Premium',
'year': 2023}
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG48740%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [auto1.fr] INFO: Saving data for WG48740: {'created_time': 1774871838.901867, 'last_price_update_time': 1774871838.90188, 'auction_closing_time': 1774972141.0}
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG48740') HTTP/1.1" 204 0
2026-03-30 11:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY98039> (referer: https://www.auto1.com/v1/car-details-view/TY98039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f62aed-418e-58b5-8964-affba1488bb9 with identifier: XR62682
2026-03-30 11:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f62aed-418e-58b5-8964-affba1488bb9 with scrape type 1
2026-03-30 11:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10f62aed-418e-58b5-8964-affba1488bb9
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_60308c64f0b18f56361243f69bdf33f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_60308c64f0b18f56361243f69bdf33f6.jpg already downloaded
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_402b5c0c59a56e8440cacae831638d8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_402b5c0c59a56e8440cacae831638d8e.jpg already downloaded
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_f2f2d0c56a2876a1e0f195517475e2ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_f2f2d0c56a2876a1e0f195517475e2ce.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_b11c58520386235961a1dc607fddaab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b11c58520386235961a1dc607fddaab6.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_59327e3a878510001da8bad57679986d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_59327e3a878510001da8bad57679986d.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_3efa23b7673b09b0cbf0af5668e49dcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_3efa23b7673b09b0cbf0af5668e49dcc.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_d415cc70723967d00109a29a20f16a3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_d415cc70723967d00109a29a20f16a3a.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_015fc77c1d83223858150c44a2c49289.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_015fc77c1d83223858150c44a2c49289.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_b0e3b01f05175bee3099e4e587b24c37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b0e3b01f05175bee3099e4e587b24c37.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F08%252F7e082b8d3e390d4ea56eb653b282973a%252Fpa%252FXR62682_4d03d42902183b0e928a9dc02f96b96b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_4d03d42902183b0e928a9dc02f96b96b.jpg already downloaded
2026-03-30 11:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10f62aed-418e-58b5-8964-affba1488bb9, identifier: XR62682
2026-03-30 11:57:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ccca6fc-4b9f-590d-8f3a-ca2452de7834 with identifier: PR62918
2026-03-30 11:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ccca6fc-4b9f-590d-8f3a-ca2452de7834 with scrape type 1
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6ccca6fc-4b9f-590d-8f3a-ca2452de7834
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_250a56e06f8d6e71819fdfc55965a3f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_250a56e06f8d6e71819fdfc55965a3f2.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_3ee8f288dd70e65f099ecccc64c74b31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_3ee8f288dd70e65f099ecccc64c74b31.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_7ad4256c9b16bf6f1f596ddd46b1f9c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_7ad4256c9b16bf6f1f596ddd46b1f9c6.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_edf0499af14cfb0efd4d70d3cdeec650.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_edf0499af14cfb0efd4d70d3cdeec650.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_d6766442d2abc4c0efe7c6663d91ab3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_d6766442d2abc4c0efe7c6663d91ab3a.jpg already downloaded
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca37097aaacb80c4442376cc71c4c6a%252Fpa%252FPR62918_38177e147c775dea584b1800eef4702e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_38177e147c775dea584b1800eef4702e.jpg already downloaded
2026-03-30 11:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ccca6fc-4b9f-590d-8f3a-ca2452de7834, identifier: PR62918
2026-03-30 11:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10f62aed-418e-58b5-8964-affba1488bb9 with identifier: XR62682
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:57:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10f62aed-418e-58b5-8964-affba1488bb9 with identifier: XR62682
2026-03-30 11:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10f62aed-418e-58b5-8964-affba1488bb9 with identifier: XR62682 to the API
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR62682>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:14:43Z',
'fuel_type': 'diesel',
'id': '10f62aed-418e-58b5-8964-affba1488bb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR62682',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Renault',
'model': 'Captur',
'odometer': 194611,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_60308c64f0b18f56361243f69bdf33f6.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_402b5c0c59a56e8440cacae831638d8e.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_f2f2d0c56a2876a1e0f195517475e2ce.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b11c58520386235961a1dc607fddaab6.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_59327e3a878510001da8bad57679986d.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_3efa23b7673b09b0cbf0af5668e49dcc.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_d415cc70723967d00109a29a20f16a3a.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_015fc77c1d83223858150c44a2c49289.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b0e3b01f05175bee3099e4e587b24c37.jpg',
'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_4d03d42902183b0e928a9dc02f96b96b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_60308c64f0b18f56361243f69bdf33f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_402b5c0c59a56e8440cacae831638d8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_f2f2d0c56a2876a1e0f195517475e2ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b11c58520386235961a1dc607fddaab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_59327e3a878510001da8bad57679986d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_3efa23b7673b09b0cbf0af5668e49dcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2805082,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_d415cc70723967d00109a29a20f16a3a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_015fc77c1d83223858150c44a2c49289.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_b0e3b01f05175bee3099e4e587b24c37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10f62aed-418e-58b5-8964-affba1488bb9/10f62aed-418e-58b5-8964-affba1488bb9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/08/7e082b8d3e390d4ea56eb653b282973a/pa/XR62682_4d03d42902183b0e928a9dc02f96b96b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR62682%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.fr] INFO: Saving data for XR62682: {'created_time': 1774871840.372037, 'last_price_update_time': 1774871840.372049, 'auction_closing_time': 1774970083.0}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR62682') HTTP/1.1" 204 0
2026-03-30 11:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ccca6fc-4b9f-590d-8f3a-ca2452de7834 with identifier: PR62918
2026-03-30 11:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ccca6fc-4b9f-590d-8f3a-ca2452de7834 with identifier: PR62918
2026-03-30 11:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ccca6fc-4b9f-590d-8f3a-ca2452de7834 with identifier: PR62918 to the API
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR62918>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:01Z',
'fuel_type': 'diesel',
'id': '6ccca6fc-4b9f-590d-8f3a-ca2452de7834',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR62918',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '3008',
'odometer': 240827,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_250a56e06f8d6e71819fdfc55965a3f2.jpg',
'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_3ee8f288dd70e65f099ecccc64c74b31.jpg',
'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_7ad4256c9b16bf6f1f596ddd46b1f9c6.jpg',
'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_edf0499af14cfb0efd4d70d3cdeec650.jpg',
'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_d6766442d2abc4c0efe7c6663d91ab3a.jpg',
'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_38177e147c775dea584b1800eef4702e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_250a56e06f8d6e71819fdfc55965a3f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_3ee8f288dd70e65f099ecccc64c74b31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_7ad4256c9b16bf6f1f596ddd46b1f9c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_edf0499af14cfb0efd4d70d3cdeec650.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_d6766442d2abc4c0efe7c6663d91ab3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ccca6fc-4b9f-590d-8f3a-ca2452de7834/6ccca6fc-4b9f-590d-8f3a-ca2452de7834_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca37097aaacb80c4442376cc71c4c6a/pa/PR62918_38177e147c775dea584b1800eef4702e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2010}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR62918%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [auto1.fr] INFO: Saving data for PR62918: {'created_time': 1774871840.696773, 'last_price_update_time': 1774871840.696784, 'auction_closing_time': 1774970701.0}
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR62918') HTTP/1.1" 204 0
2026-03-30 11:57:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbce882-480e-5674-b598-70cb1ed9acee with identifier: TY98039
2026-03-30 11:57:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbce882-480e-5674-b598-70cb1ed9acee with scrape type 1
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bbce882-480e-5674-b598-70cb1ed9acee
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_427c7d8b8ee728e514f6975c77fd9714.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_427c7d8b8ee728e514f6975c77fd9714.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_b884b5675456151a34178fb22122d723.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b884b5675456151a34178fb22122d723.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_f091e17cdfb08325a8d0b16c9d1c0cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_f091e17cdfb08325a8d0b16c9d1c0cfe.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_ceca372bb38c3c00cc3b5a8fff039c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ceca372bb38c3c00cc3b5a8fff039c77.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_8c83bb2ba4bb2ae1ef02961b723e8472.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_8c83bb2ba4bb2ae1ef02961b723e8472.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_ee02facfc324e88a17fbb5eb57d30713.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ee02facfc324e88a17fbb5eb57d30713.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_b5ae1c7f62fc7911a99dd8ab8f8e5b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b5ae1c7f62fc7911a99dd8ab8f8e5b12.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_fa92672f21583549f83b29a4dea4d02a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_fa92672f21583549f83b29a4dea4d02a.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_d9a76e60066a0563d88997d72dc0f3ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d9a76e60066a0563d88997d72dc0f3ab.jpg already downloaded
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F9d%252F379d63fe806f3637dcbf7c98bda07d9b%252Fpa%252FTY98039_d7ff2452e0dd82d52ab21f310262ea77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d7ff2452e0dd82d52ab21f310262ea77.jpg already downloaded
2026-03-30 11:57:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6bbce882-480e-5674-b598-70cb1ed9acee, identifier: TY98039
2026-03-30 11:57:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6bbce882-480e-5674-b598-70cb1ed9acee with identifier: TY98039
2026-03-30 11:57:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6bbce882-480e-5674-b598-70cb1ed9acee with identifier: TY98039
2026-03-30 11:57:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6bbce882-480e-5674-b598-70cb1ed9acee with identifier: TY98039 to the API
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY98039>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:19:46Z',
'fuel_type': 'diesel',
'id': '6bbce882-480e-5674-b598-70cb1ed9acee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY98039',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '3008',
'odometer': 226328,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_427c7d8b8ee728e514f6975c77fd9714.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b884b5675456151a34178fb22122d723.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_f091e17cdfb08325a8d0b16c9d1c0cfe.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ceca372bb38c3c00cc3b5a8fff039c77.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_8c83bb2ba4bb2ae1ef02961b723e8472.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ee02facfc324e88a17fbb5eb57d30713.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b5ae1c7f62fc7911a99dd8ab8f8e5b12.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_fa92672f21583549f83b29a4dea4d02a.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d9a76e60066a0563d88997d72dc0f3ab.jpg',
'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d7ff2452e0dd82d52ab21f310262ea77.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2584966,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_427c7d8b8ee728e514f6975c77fd9714.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b884b5675456151a34178fb22122d723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_f091e17cdfb08325a8d0b16c9d1c0cfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2704048,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ceca372bb38c3c00cc3b5a8fff039c77.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_8c83bb2ba4bb2ae1ef02961b723e8472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2878756,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_ee02facfc324e88a17fbb5eb57d30713.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_b5ae1c7f62fc7911a99dd8ab8f8e5b12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_fa92672f21583549f83b29a4dea4d02a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d9a76e60066a0563d88997d72dc0f3ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbce882-480e-5674-b598-70cb1ed9acee/6bbce882-480e-5674-b598-70cb1ed9acee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/9d/379d63fe806f3637dcbf7c98bda07d9b/pa/TY98039_d7ff2452e0dd82d52ab21f310262ea77.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2015}
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY98039%27 HTTP/1.1" 200 None
2026-03-30 11:57:21 [auto1.fr] INFO: Saving data for TY98039: {'created_time': 1774871841.330933, 'last_price_update_time': 1774871841.330946, 'auction_closing_time': 1774970386.0}
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY98039') HTTP/1.1" 204 0
2026-03-30 11:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR82723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR82723> (referer: https://www.auto1.com/v1/car-details-view/TR82723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0830d32-72bb-52b8-99f0-3357a9ed4f0e with identifier: TR82723
2026-03-30 11:57:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e with scrape type 1
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_42fdb01b01a55797b1409a3906b78e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_42fdb01b01a55797b1409a3906b78e82.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_b2e21502d2ea52bb922581917ed41728.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_b2e21502d2ea52bb922581917ed41728.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_80cf117346f74e577981bfe0a0660eb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_80cf117346f74e577981bfe0a0660eb6.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg not downloaded yet
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_42fdb01b01a55797b1409a3906b78e82.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_ccb0db85a0a54717869c868b89ad4da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_ccb0db85a0a54717869c868b89ad4da8.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg not downloaded yet
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_b2e21502d2ea52bb922581917ed41728.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_55ac1a43a50334664c4001a9d64afa60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_55ac1a43a50334664c4001a9d64afa60.jpg not downloaded yet
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg not downloaded yet
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72882ceb50>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_42fdb01b01a55797b1409a3906b78e82.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_42fdb01b01a55797b1409a3906b78e82.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf4110>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_b2e21502d2ea52bb922581917ed41728.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_b2e21502d2ea52bb922581917ed41728.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_80cf117346f74e577981bfe0a0660eb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_ccb0db85a0a54717869c868b89ad4da8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850f1410>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_55ac1a43a50334664c4001a9d64afa60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc35d0>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aac290>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ae0590>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_80cf117346f74e577981bfe0a0660eb6.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_80cf117346f74e577981bfe0a0660eb6.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd0e50>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_ccb0db85a0a54717869c868b89ad4da8.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_ccb0db85a0a54717869c868b89ad4da8.jpg saved to cache
2026-03-30 11:57:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287a3f390>
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_55ac1a43a50334664c4001a9d64afa60.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_55ac1a43a50334664c4001a9d64afa60.jpg saved to cache
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c0f9d0>
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg saved to cache
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc2bd0>
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:57:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F7b%252F367be4f7a629d65405c28f621427c473%252Fpa%252FTR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg') HTTP/1.1" 204 0
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg saved to cache
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e
2026-03-30 11:57:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0830d32-72bb-52b8-99f0-3357a9ed4f0e, skipping ID generation
2026-03-30 11:57:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e with scrape type 1
2026-03-30 11:57:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0830d32-72bb-52b8-99f0-3357a9ed4f0e sending to next pipeline
2026-03-30 11:57:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0830d32-72bb-52b8-99f0-3357a9ed4f0e, identifier: TR82723
2026-03-30 11:57:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0830d32-72bb-52b8-99f0-3357a9ed4f0e with identifier: TR82723
2026-03-30 11:57:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0830d32-72bb-52b8-99f0-3357a9ed4f0e with identifier: TR82723
2026-03-30 11:57:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0830d32-72bb-52b8-99f0-3357a9ed4f0e with identifier: TR82723 to the API
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:44:18Z',
'fuel_type': 'petrol',
'id': 'b0830d32-72bb-52b8-99f0-3357a9ed4f0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR82723',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'MINI',
'model': 'Clubman',
'odometer': 98443,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_42fdb01b01a55797b1409a3906b78e82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_01de813b1208c4e910e6370f4ed9d7ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_b2e21502d2ea52bb922581917ed41728.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_d5a4cd9dc00bcdccc25d69ad07c92962.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_80cf117346f74e577981bfe0a0660eb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_dc2e61697ef47de68eb433ffd3feb60c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_ccb0db85a0a54717869c868b89ad4da8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_9f2634d51acd60134c6e353d9fb5f97f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_55ac1a43a50334664c4001a9d64afa60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0830d32-72bb-52b8-99f0-3357a9ed4f0e/b0830d32-72bb-52b8-99f0-3357a9ed4f0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/7b/367be4f7a629d65405c28f621427c473/pa/TR82723_c3f7e511e0b3f37fcb9c5cd1ef5e9039.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Clubman Cooper',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR82723%27 HTTP/1.1" 200 None
2026-03-30 11:57:34 [auto1.fr] INFO: Saving data for TR82723: {'created_time': 1774871854.64801, 'last_price_update_time': 1774871854.648027, 'auction_closing_time': 1774971858.0}
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR82723') HTTP/1.1" 204 0
2026-03-30 11:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:53 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 5675 | hits on page: 40
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: EJ67519
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: YE22009
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE22009%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for YE22009: 0
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: TR82723
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR82723%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for TR82723: 0
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: XR62682
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR62682%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for XR62682: 0
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: VE95693
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: UY95112
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: CJ43665
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: PS01838
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: GC33041
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: HF19797
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: EW48077
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW48077%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for EW48077: 1
2026-03-30 11:57:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: DP87116
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP87116%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for DP87116: 2
2026-03-30 11:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458db506-5a76-54c3-94e8-66ddb52c2a68 with identifier: DP87116
2026-03-30 11:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458db506-5a76-54c3-94e8-66ddb52c2a68 with scrape type 2
2026-03-30 11:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458db506-5a76-54c3-94e8-66ddb52c2a68 with scrape type 2
2026-03-30 11:57:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 458db506-5a76-54c3-94e8-66ddb52c2a68, identifier: DP87116
2026-03-30 11:57:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 458db506-5a76-54c3-94e8-66ddb52c2a68 with identifier: DP87116
2026-03-30 11:57:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 458db506-5a76-54c3-94e8-66ddb52c2a68 with identifier: DP87116
2026-03-30 11:57:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 458db506-5a76-54c3-94e8-66ddb52c2a68 with identifier: DP87116 to the API
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:39:35Z',
'fuel_type': 'diesel',
'id': '458db506-5a76-54c3-94e8-66ddb52c2a68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP87116',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 225266,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-12',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2010}
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP87116%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Saving data for DP87116: {'auction_closing_time': 1774971575.0, 'created_time': 1773778237.57441, 'last_price_update_time': 1774871873.785289}
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP87116') HTTP/1.1" 204 0
2026-03-30 11:57:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: CJ65554
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: WM44458
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: US82049
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US82049%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for US82049: 1
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: FU59692
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: BF40383
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF40383%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for BF40383: 1
2026-03-30 11:57:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: KH83652
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: GT82965
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT82965%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for GT82965: 1
2026-03-30 11:57:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: PY37757
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: WJ68897
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: AE60710
2026-03-30 11:57:53 [auto1.fr] INFO: Found listing with ID: MS31119
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS31119%27 HTTP/1.1" 200 None
2026-03-30 11:57:53 [auto1.fr] INFO: Scrape type for MS31119: 2
2026-03-30 11:57:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7b7824-4804-584f-a2c5-d57ebf309c3d with identifier: MS31119
2026-03-30 11:57:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7b7824-4804-584f-a2c5-d57ebf309c3d with scrape type 2
2026-03-30 11:57:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7b7824-4804-584f-a2c5-d57ebf309c3d with scrape type 2
2026-03-30 11:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f7b7824-4804-584f-a2c5-d57ebf309c3d, identifier: MS31119
2026-03-30 11:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f7b7824-4804-584f-a2c5-d57ebf309c3d with identifier: MS31119
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:57:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f7b7824-4804-584f-a2c5-d57ebf309c3d with identifier: MS31119
2026-03-30 11:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f7b7824-4804-584f-a2c5-d57ebf309c3d with identifier: MS31119 to the API
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:05:57Z',
'fuel_type': 'petrol',
'id': '4f7b7824-4804-584f-a2c5-d57ebf309c3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS31119',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 191616,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-04',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS31119%27 HTTP/1.1" 200 None
2026-03-30 11:57:54 [auto1.fr] INFO: Saving data for MS31119: {'auction_closing_time': 1774969557.0, 'created_time': 1774124068.180252, 'last_price_update_time': 1774871874.593927}
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS31119') HTTP/1.1" 204 0
2026-03-30 11:57:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:54 [auto1.fr] INFO: Found listing with ID: SY02908
2026-03-30 11:57:54 [auto1.fr] INFO: Found listing with ID: WL46788
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL46788%27 HTTP/1.1" 200 None
2026-03-30 11:57:54 [auto1.fr] INFO: Scrape type for WL46788: 1
2026-03-30 11:57:54 [auto1.fr] INFO: Found listing with ID: TR38614
2026-03-30 11:57:54 [auto1.fr] INFO: Found listing with ID: PX84872
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX84872%27 HTTP/1.1" 200 None
2026-03-30 11:57:54 [auto1.fr] INFO: Scrape type for PX84872: 2
2026-03-30 11:57:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with identifier: PX84872
2026-03-30 11:57:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with scrape type 2
2026-03-30 11:57:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with scrape type 2
2026-03-30 11:57:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a18d2e5-9b70-5063-a8cb-3a7aa6682404, identifier: PX84872
2026-03-30 11:57:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with identifier: PX84872
2026-03-30 11:57:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with identifier: PX84872
2026-03-30 11:57:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a18d2e5-9b70-5063-a8cb-3a7aa6682404 with identifier: PX84872 to the API
2026-03-30 11:57:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:14:56Z',
'fuel_type': 'diesel',
'id': '0a18d2e5-9b70-5063-a8cb-3a7aa6682404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX84872',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 189287,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-28',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 R Design AWD',
'transmission': 'automatic',
'trim': 'R Design AWD',
'year': 2018}
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX84872%27 HTTP/1.1" 200 None
2026-03-30 11:57:55 [auto1.fr] INFO: Saving data for PX84872: {'auction_closing_time': 1774970096.0, 'created_time': 1772280221.832274, 'last_price_update_time': 1774871875.160059}
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX84872') HTTP/1.1" 204 0
2026-03-30 11:57:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: KF83759
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF83759%27 HTTP/1.1" 200 None
2026-03-30 11:57:55 [auto1.fr] INFO: Scrape type for KF83759: 2
2026-03-30 11:57:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14870b4b-5b8c-5999-b663-873a9bc0852c with identifier: KF83759
2026-03-30 11:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14870b4b-5b8c-5999-b663-873a9bc0852c with scrape type 2
2026-03-30 11:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14870b4b-5b8c-5999-b663-873a9bc0852c with scrape type 2
2026-03-30 11:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14870b4b-5b8c-5999-b663-873a9bc0852c, identifier: KF83759
2026-03-30 11:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14870b4b-5b8c-5999-b663-873a9bc0852c with identifier: KF83759
2026-03-30 11:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14870b4b-5b8c-5999-b663-873a9bc0852c with identifier: KF83759
2026-03-30 11:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14870b4b-5b8c-5999-b663-873a9bc0852c with identifier: KF83759 to the API
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:04:22Z',
'fuel_type': 'petrol',
'id': '14870b4b-5b8c-5999-b663-873a9bc0852c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF83759',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 185361,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-29',
'seller_name': None,
'title': 'Peugeot 2008 1.2 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2013}
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF83759%27 HTTP/1.1" 200 None
2026-03-30 11:57:55 [auto1.fr] INFO: Saving data for KF83759: {'auction_closing_time': 1774969462.0, 'created_time': 1773663886.619605, 'last_price_update_time': 1774871875.608502}
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF83759') HTTP/1.1" 204 0
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: CD05878
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: CK74331
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: GH16214
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: NT44127
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: BT51576
2026-03-30 11:57:55 [auto1.fr] INFO: Found listing with ID: DV54459
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV54459%27 HTTP/1.1" 200 None
2026-03-30 11:57:55 [auto1.fr] INFO: Scrape type for DV54459: 2
2026-03-30 11:57:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19fbe2f5-cc73-51a7-8331-e13c228889d8 with identifier: DV54459
2026-03-30 11:57:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19fbe2f5-cc73-51a7-8331-e13c228889d8 with scrape type 2
2026-03-30 11:57:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19fbe2f5-cc73-51a7-8331-e13c228889d8 with scrape type 2
2026-03-30 11:57:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19fbe2f5-cc73-51a7-8331-e13c228889d8, identifier: DV54459
2026-03-30 11:57:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19fbe2f5-cc73-51a7-8331-e13c228889d8 with identifier: DV54459
2026-03-30 11:57:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19fbe2f5-cc73-51a7-8331-e13c228889d8 with identifier: DV54459
2026-03-30 11:57:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19fbe2f5-cc73-51a7-8331-e13c228889d8 with identifier: DV54459 to the API
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:57:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:57:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:19:07Z',
'fuel_type': 'petrol',
'id': '19fbe2f5-cc73-51a7-8331-e13c228889d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV54459',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 165154,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-27',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2010}
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV54459%27 HTTP/1.1" 200 None
2026-03-30 11:57:56 [auto1.fr] INFO: Saving data for DV54459: {'auction_closing_time': 1774970347.0, 'created_time': 1774106092.440457, 'last_price_update_time': 1774871876.051706}
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV54459') HTTP/1.1" 204 0
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: NS21275
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS21275%27 HTTP/1.1" 200 None
2026-03-30 11:57:56 [auto1.fr] INFO: Scrape type for NS21275: 1
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: YF83787
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: MH87240
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: SS47680
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: YU56432
2026-03-30 11:57:56 [auto1.fr] INFO: Found listing with ID: CU45750
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU45750%27 HTTP/1.1" 200 None
2026-03-30 11:57:56 [auto1.fr] INFO: Scrape type for CU45750: 1
2026-03-30 11:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF40383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:58 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 12 pages/min), scraped 29 items (at 12 items/min)
2026-03-30 11:57:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:58:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT82965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US82049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU45750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW48077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US82049> (referer: https://www.auto1.com/v1/car-details-view/US82049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c527955-8bdb-58c8-8d55-035228fdef44 with identifier: US82049
2026-03-30 11:58:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c527955-8bdb-58c8-8d55-035228fdef44 with scrape type 1
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_7be066945d04935673b11c675936e3f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_7be066945d04935673b11c675936e3f8.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_9be080173b7697dd615a65d60cd97ab4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_9be080173b7697dd615a65d60cd97ab4.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_31d889da5bf7575d8167a53b2d8d7f70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_31d889da5bf7575d8167a53b2d8d7f70.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_42da215db749278547f067bd31c595cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_42da215db749278547f067bd31c595cb.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_b185c292e73290356df7b68f8d8b40ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_b185c292e73290356df7b68f8d8b40ce.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_f049d9e3ec8128ad54393312c50cb603.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_f049d9e3ec8128ad54393312c50cb603.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_680c150a4146797bb7c4e7c1a8f5af08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_680c150a4146797bb7c4e7c1a8f5af08.jpg not downloaded yet
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg not downloaded yet
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_7be066945d04935673b11c675936e3f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a3ffd0>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_7be066945d04935673b11c675936e3f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_7be066945d04935673b11c675936e3f8.jpg saved to cache
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_31d889da5bf7575d8167a53b2d8d7f70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_b185c292e73290356df7b68f8d8b40ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_9be080173b7697dd615a65d60cd97ab4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_42da215db749278547f067bd31c595cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c59d90>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_31d889da5bf7575d8167a53b2d8d7f70.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_31d889da5bf7575d8167a53b2d8d7f70.jpg saved to cache
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a78850>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_b185c292e73290356df7b68f8d8b40ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_b185c292e73290356df7b68f8d8b40ce.jpg saved to cache
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fef90>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_9be080173b7697dd615a65d60cd97ab4.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_9be080173b7697dd615a65d60cd97ab4.jpg saved to cache
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285089310>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg saved to cache
2026-03-30 11:58:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508ae10>
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_42da215db749278547f067bd31c595cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_42da215db749278547f067bd31c595cb.jpg saved to cache
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fe890>
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg saved to cache
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a78910>
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg saved to cache
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_f049d9e3ec8128ad54393312c50cb603.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_680c150a4146797bb7c4e7c1a8f5af08.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508fc90>
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_f049d9e3ec8128ad54393312c50cb603.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_f049d9e3ec8128ad54393312c50cb603.jpg saved to cache
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd35d0>
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F19%252F2919dfa87cdbaff4294d7e33c68a79f2%252Fpa%252FUS82049_680c150a4146797bb7c4e7c1a8f5af08.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_680c150a4146797bb7c4e7c1a8f5af08.jpg saved to cache
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c527955-8bdb-58c8-8d55-035228fdef44
2026-03-30 11:58:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c527955-8bdb-58c8-8d55-035228fdef44, skipping ID generation
2026-03-30 11:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c527955-8bdb-58c8-8d55-035228fdef44 with scrape type 1
2026-03-30 11:58:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c527955-8bdb-58c8-8d55-035228fdef44 sending to next pipeline
2026-03-30 11:58:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c527955-8bdb-58c8-8d55-035228fdef44, identifier: US82049
2026-03-30 11:58:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c527955-8bdb-58c8-8d55-035228fdef44 with identifier: US82049
2026-03-30 11:58:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c527955-8bdb-58c8-8d55-035228fdef44 with identifier: US82049
2026-03-30 11:58:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c527955-8bdb-58c8-8d55-035228fdef44 with identifier: US82049 to the API
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_680c150a4146797bb7c4e7c1a8f5af08.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:32:00Z',
'fuel_type': 'petrol',
'id': '3c527955-8bdb-58c8-8d55-035228fdef44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US82049',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Renault',
'model': 'Captur',
'odometer': 89156,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_7be066945d04935673b11c675936e3f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_9be080173b7697dd615a65d60cd97ab4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_31d889da5bf7575d8167a53b2d8d7f70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_42da215db749278547f067bd31c595cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_5ff0149f80ff4a01774f4c10f9c9d5ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_b185c292e73290356df7b68f8d8b40ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_66709a9261bfbc13cc0ef7ce80c2db39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_f049d9e3ec8128ad54393312c50cb603.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_680c150a4146797bb7c4e7c1a8f5af08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c527955-8bdb-58c8-8d55-035228fdef44/3c527955-8bdb-58c8-8d55-035228fdef44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/19/2919dfa87cdbaff4294d7e33c68a79f2/pa/US82049_d8da080b1c8c3ccad81c177f9fbbeec8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2019}
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US82049%27 HTTP/1.1" 200 None
2026-03-30 11:58:26 [auto1.fr] INFO: Saving data for US82049: {'created_time': 1774871906.741542, 'last_price_update_time': 1774871906.741552, 'auction_closing_time': 1774971120.0}
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US82049') HTTP/1.1" 204 0
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT82965> (referer: https://www.auto1.com/v1/car-details-view/GT82965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with identifier: GT82965
2026-03-30 11:58:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with scrape type 1
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_07a9be1b1294fbccf004047d39d3899f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_07a9be1b1294fbccf004047d39d3899f.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_68a987b6774afb04924bdce5322063f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_68a987b6774afb04924bdce5322063f5.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_53e9741561c561ebb061db7337dc0b31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_53e9741561c561ebb061db7337dc0b31.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_2de60362238758cbe767c6b0ba9161df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_2de60362238758cbe767c6b0ba9161df.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_d1024969d951d51883da5c1550be70b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d1024969d951d51883da5c1550be70b0.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_d7f09fd539e17afca140034232af5621.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d7f09fd539e17afca140034232af5621.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_808a90f8333ee104c4382825d12cb4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_808a90f8333ee104c4382825d12cb4df.jpg not downloaded yet
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_68a987b6774afb04924bdce5322063f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg not downloaded yet
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg not downloaded yet
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_53e9741561c561ebb061db7337dc0b31.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_07a9be1b1294fbccf004047d39d3899f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg not downloaded yet
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d1024969d951d51883da5c1550be70b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a42850>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_68a987b6774afb04924bdce5322063f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_68a987b6774afb04924bdce5322063f5.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_2de60362238758cbe767c6b0ba9161df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a98290>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_53e9741561c561ebb061db7337dc0b31.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_53e9741561c561ebb061db7337dc0b31.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cccc50>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_07a9be1b1294fbccf004047d39d3899f.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_07a9be1b1294fbccf004047d39d3899f.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_808a90f8333ee104c4382825d12cb4df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d7f09fd539e17afca140034232af5621.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc7d10>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_d1024969d951d51883da5c1550be70b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d1024969d951d51883da5c1550be70b0.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512c050>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b591d0>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_2de60362238758cbe767c6b0ba9161df.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_2de60362238758cbe767c6b0ba9161df.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859fb690>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c37390>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_808a90f8333ee104c4382825d12cb4df.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_808a90f8333ee104c4382825d12cb4df.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c64350>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg saved to cache
2026-03-30 11:58:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287ccd110>
2026-03-30 11:58:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Ffb%252Fc4fb43c88fb3a63b9ca0ac6c19a10584%252Fpa%252FGT82965_d7f09fd539e17afca140034232af5621.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d7f09fd539e17afca140034232af5621.jpg saved to cache
2026-03-30 11:58:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8
2026-03-30 11:58:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8, skipping ID generation
2026-03-30 11:58:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with scrape type 1
2026-03-30 11:58:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 sending to next pipeline
2026-03-30 11:58:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8, identifier: GT82965
2026-03-30 11:58:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with identifier: GT82965
2026-03-30 11:58:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with identifier: GT82965
2026-03-30 11:58:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6656e999-1d99-5f3c-b12b-3fe4f2db40f8 with identifier: GT82965 to the API
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d7f09fd539e17afca140034232af5621.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:47:16Z',
'fuel_type': 'diesel',
'id': '6656e999-1d99-5f3c-b12b-3fe4f2db40f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT82965',
'listing': 'auction',
'location': 'FR, Périgny',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 119231,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_07a9be1b1294fbccf004047d39d3899f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_68a987b6774afb04924bdce5322063f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_53e9741561c561ebb061db7337dc0b31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_2de60362238758cbe767c6b0ba9161df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d1024969d951d51883da5c1550be70b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_d7f09fd539e17afca140034232af5621.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_808a90f8333ee104c4382825d12cb4df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_dd48e312b1b14e8bf27bf13a8c80a6ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_c2be0f0e53b33a0f2b68fd813230e451.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6656e999-1d99-5f3c-b12b-3fe4f2db40f8/6656e999-1d99-5f3c-b12b-3fe4f2db40f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/fb/c4fb43c88fb3a63b9ca0ac6c19a10584/pa/GT82965_27b6fa222f74b3fdc50991ab0c2aad61.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Picasso 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2012}
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT82965%27 HTTP/1.1" 200 None
2026-03-30 11:58:39 [auto1.fr] INFO: Saving data for GT82965: {'created_time': 1774871919.499478, 'last_price_update_time': 1774871919.499488, 'auction_closing_time': 1774972036.0}
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT82965') HTTP/1.1" 204 0
2026-03-30 11:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW48077> (referer: https://www.auto1.com/v1/car-details-view/EW48077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with identifier: EW48077
2026-03-30 11:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with scrape type 1
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_8981f96306b6c05070ccb77018695af6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_8981f96306b6c05070ccb77018695af6.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_9a563be04e3f78727482165c38809cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_9a563be04e3f78727482165c38809cde.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_f9387efb8e6636507c67668fbdd7e197.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_f9387efb8e6636507c67668fbdd7e197.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_35b8f955778f55a516c5075805418399.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_35b8f955778f55a516c5075805418399.jpg not downloaded yet
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_8981f96306b6c05070ccb77018695af6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_5f19e1873158e38487428f678242d355.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_5f19e1873158e38487428f678242d355.jpg not downloaded yet
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_d8bcb6f78c6f176d2ca286698e608125.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d8bcb6f78c6f176d2ca286698e608125.jpg not downloaded yet
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg not downloaded yet
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_f9387efb8e6636507c67668fbdd7e197.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_5f19e1873158e38487428f678242d355.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d8bcb6f78c6f176d2ca286698e608125.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850bc050>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_8981f96306b6c05070ccb77018695af6.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_8981f96306b6c05070ccb77018695af6.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_9a563be04e3f78727482165c38809cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac04d0>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1f890>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_f9387efb8e6636507c67668fbdd7e197.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_f9387efb8e6636507c67668fbdd7e197.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287d9db10>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_5f19e1873158e38487428f678242d355.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_5f19e1873158e38487428f678242d355.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_35b8f955778f55a516c5075805418399.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287d96050>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_d8bcb6f78c6f176d2ca286698e608125.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d8bcb6f78c6f176d2ca286698e608125.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285123890>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_9a563be04e3f78727482165c38809cde.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_9a563be04e3f78727482165c38809cde.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285103910>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a63710>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c35290>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_35b8f955778f55a516c5075805418399.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_35b8f955778f55a516c5075805418399.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c37050>
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:58:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F6d%252Fcd6d086f37397a143a669d631d27e860%252Fpa%252FEW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg saved to cache
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c
2026-03-30 11:58:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c, skipping ID generation
2026-03-30 11:58:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with scrape type 1
2026-03-30 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c sending to next pipeline
2026-03-30 11:58:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c, identifier: EW48077
2026-03-30 11:58:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with identifier: EW48077
2026-03-30 11:58:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with identifier: EW48077
2026-03-30 11:58:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c with identifier: EW48077 to the API
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:34:22Z',
'fuel_type': 'diesel',
'id': '9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW48077',
'listing': 'auction',
'location': 'FR, 59330',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 77142,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_8981f96306b6c05070ccb77018695af6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_9a563be04e3f78727482165c38809cde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d73bd866d04c2fad7bb6f42a54ee39b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_a4b229f8bca8afcc1c08b4723e03c7e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_7dd3d4ca9632f5ddfd05f881dd984c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_f9387efb8e6636507c67668fbdd7e197.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_35b8f955778f55a516c5075805418399.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_5f19e1873158e38487428f678242d355.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_d8bcb6f78c6f176d2ca286698e608125.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c/9c43ba6e-7bba-5f96-9e2b-53d9e6a6a94c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/6d/cd6d086f37397a143a669d631d27e860/pa/EW48077_06f025375e2c19f956e7bb23f8abd3c6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Brooklyn Edition FWD',
'transmission': 'manual',
'trim': 'Brooklyn Edition FWD',
'year': 2019}
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW48077%27 HTTP/1.1" 200 None
2026-03-30 11:58:44 [auto1.fr] INFO: Saving data for EW48077: {'created_time': 1774871924.372407, 'last_price_update_time': 1774871924.372418, 'auction_closing_time': 1774971262.0}
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW48077') HTTP/1.1" 204 0
2026-03-30 11:58:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.402(s), this was the 1st time calling it.
2026-03-30 11:58:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.131249676557478 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU45750> (referer: https://www.auto1.com/v1/car-details-view/CU45750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-03-30 11:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with scrape type 1
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24b67b4d-806d-5830-b6ee-1c2ce8e0e172
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_08614881f3dd74e577d0e739161bf3fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_7f7acccb008d13185234a498eb14fe86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_7f7acccb008d13185234a498eb14fe86.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_431bc8c0b03161e42cba8250ee25d810.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_c63236d09a1f1675ad34141912de03ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_1b5118349e3888388ee1ea05f26e3e54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg already downloaded
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fd25cdc002b01f1a45adc490a3bc9%252Fpa%252FCU45750_32e4de9aae60309dc50e932c78a68783.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg already downloaded
2026-03-30 11:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172, identifier: CU45750
2026-03-30 11:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-03-30 11:58:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750
2026-03-30 11:58:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24b67b4d-806d-5830-b6ee-1c2ce8e0e172 with identifier: CU45750 to the API
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU45750>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:16:26Z',
'fuel_type': 'diesel',
'id': '24b67b4d-806d-5830-b6ee-1c2ce8e0e172',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU45750',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 285224,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_7f7acccb008d13185234a498eb14fe86.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg',
'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_bd89355f9943be89aa0da60ef5dcfb5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_ab1a03c8b1787c21bd62aa0c0d34b625.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_08614881f3dd74e577d0e739161bf3fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c2e236cd9fd55966a77faa67f9ba8cc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2834542,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_f5f87a2653d0e423cf88dd573ff8f9b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_7f7acccb008d13185234a498eb14fe86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_431bc8c0b03161e42cba8250ee25d810.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_c63236d09a1f1675ad34141912de03ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_1b5118349e3888388ee1ea05f26e3e54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b67b4d-806d-5830-b6ee-1c2ce8e0e172/24b67b4d-806d-5830-b6ee-1c2ce8e0e172_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fd25cdc002b01f1a45adc490a3bc9/pa/CU45750_32e4de9aae60309dc50e932c78a68783.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2008}
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU45750%27 HTTP/1.1" 200 None
2026-03-30 11:58:58 [auto1.fr] INFO: Saving data for CU45750: {'created_time': 1774871938.682118, 'last_price_update_time': 1774871938.682129, 'auction_closing_time': 1774970186.0}
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU45750') HTTP/1.1" 204 0
2026-03-30 11:58:58 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 8 pages/min), scraped 33 items (at 4 items/min)
2026-03-30 11:58:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:59:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS21275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS21275> (referer: https://www.auto1.com/v1/car-details-view/NS21275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with identifier: NS21275
2026-03-30 11:59:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with scrape type 1
2026-03-30 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg not downloaded yet
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_8f1964d96228313a73e3772e1a953c5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8f1964d96228313a73e3772e1a953c5c.jpg not downloaded yet
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_c17caecdeaca0eb6091e1033815f7002.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_c17caecdeaca0eb6091e1033815f7002.jpg not downloaded yet
2026-03-30 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg not downloaded yet
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_93c04d275e6950d0f7b68b0618e9a664.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_93c04d275e6950d0f7b68b0618e9a664.jpg not downloaded yet
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg not downloaded yet
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_801592e288e579cc5ccfb9656acd91b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_801592e288e579cc5ccfb9656acd91b9.jpg not downloaded yet
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8f1964d96228313a73e3772e1a953c5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg not downloaded yet
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg not downloaded yet
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_c17caecdeaca0eb6091e1033815f7002.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_5993f569e2827403c513e6dee6a54c97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_5993f569e2827403c513e6dee6a54c97.jpg not downloaded yet
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_93c04d275e6950d0f7b68b0618e9a664.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_5993f569e2827403c513e6dee6a54c97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd2e90>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_801592e288e579cc5ccfb9656acd91b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a43e10>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_8f1964d96228313a73e3772e1a953c5c.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8f1964d96228313a73e3772e1a953c5c.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ae2fd0>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285156ed0>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_c17caecdeaca0eb6091e1033815f7002.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_c17caecdeaca0eb6091e1033815f7002.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6a5d0>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a99a50>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_93c04d275e6950d0f7b68b0618e9a664.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_93c04d275e6950d0f7b68b0618e9a664.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b61890>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_5993f569e2827403c513e6dee6a54c97.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_5993f569e2827403c513e6dee6a54c97.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513ca50>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_801592e288e579cc5ccfb9656acd91b9.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_801592e288e579cc5ccfb9656acd91b9.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b68f10>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72851452d0>
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F23%252F2a23af2db6a5bd131a53d0522a92b8d4%252Fpa%252FNS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg saved to cache
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea
2026-03-30 11:59:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea, skipping ID generation
2026-03-30 11:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with scrape type 1
2026-03-30 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 180e64f7-c59e-5b42-86f6-6a1ce099c6ea sending to next pipeline
2026-03-30 11:59:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea, identifier: NS21275
2026-03-30 11:59:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with identifier: NS21275
2026-03-30 11:59:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with identifier: NS21275
2026-03-30 11:59:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 180e64f7-c59e-5b42-86f6-6a1ce099c6ea with identifier: NS21275 to the API
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 145,
'expiration_date': '2026-03-31T15:38:40Z',
'fuel_type': 'diesel',
'id': '180e64f7-c59e-5b42-86f6-6a1ce099c6ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS21275',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Trafic',
'odometer': 109092,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_b28f4f7bbdb3b7d0b7ee59b30d898a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8f1964d96228313a73e3772e1a953c5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_c17caecdeaca0eb6091e1033815f7002.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_bad74b0662c7673d7ee8502b0261ecb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_93c04d275e6950d0f7b68b0618e9a664.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_8ce3d2d7b1dbe0ae8ddd6ed5cf4fe106.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_801592e288e579cc5ccfb9656acd91b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_e5cac423d6d307ddc9bff9259ebcd52d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_ef4d6291e2937a6af3b76e4026eee2b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_180e64f7-c59e-5b42-86f6-6a1ce099c6ea/180e64f7-c59e-5b42-86f6-6a1ce099c6ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/23/2a23af2db6a5bd131a53d0522a92b8d4/pa/NS21275_5993f569e2827403c513e6dee6a54c97.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi Energy L2H1 1300 Grand Confort',
'transmission': 'manual',
'trim': 'L2H1 1300 Grand Confort',
'year': 2021}
2026-03-30 11:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS21275%27 HTTP/1.1" 200 None
2026-03-30 11:59:06 [auto1.fr] INFO: Saving data for NS21275: {'created_time': 1774871946.036833, 'last_price_update_time': 1774871946.036845, 'auction_closing_time': 1774971520.0}
2026-03-30 11:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NS21275') HTTP/1.1" 204 0
2026-03-30 11:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR68015/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR68015> (referer: https://www.auto1.com/v1/car-details-view/GR68015/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306bbd1c-6045-51dc-b03b-371b49b93991 with identifier: GR68015
2026-03-30 11:59:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306bbd1c-6045-51dc-b03b-371b49b93991 with scrape type 1
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 306bbd1c-6045-51dc-b03b-371b49b93991
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_06b2e58a6639b09be6e5440a38206c00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_06b2e58a6639b09be6e5440a38206c00.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_4976ad24c94163aa1580ff188b124320.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_4976ad24c94163aa1580ff188b124320.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_a25b13bdebbc0e603cee39d159408190.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a25b13bdebbc0e603cee39d159408190.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_7bc90eff0895a0d55ff6e5abcc5a8a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_7bc90eff0895a0d55ff6e5abcc5a8a97.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_bc0c9439287d3004a1226acca6c68413.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_bc0c9439287d3004a1226acca6c68413.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_d5d779a79e765a4a03ca94101ffa0ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_d5d779a79e765a4a03ca94101ffa0ccc.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_a98ad2cbee7eafec82be85b35cf6b298.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a98ad2cbee7eafec82be85b35cf6b298.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_6650580a53266322370e15dd148888b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_6650580a53266322370e15dd148888b0.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_ceced134d0d3b7551b11be4fc7189d30.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_ceced134d0d3b7551b11be4fc7189d30.jpg already downloaded
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fd2%252F26d264d5a0a39c5838cdc9c71f5c9f97%252Fpa%252FGR68015_e471cbb81dbc0795a5095493e2ec3b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_e471cbb81dbc0795a5095493e2ec3b0b.jpg already downloaded
2026-03-30 11:59:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 306bbd1c-6045-51dc-b03b-371b49b93991, identifier: GR68015
2026-03-30 11:59:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 306bbd1c-6045-51dc-b03b-371b49b93991 with identifier: GR68015
2026-03-30 11:59:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 306bbd1c-6045-51dc-b03b-371b49b93991 with identifier: GR68015
2026-03-30 11:59:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 306bbd1c-6045-51dc-b03b-371b49b93991 with identifier: GR68015 to the API
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR68015>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 313,
'expiration_date': '2026-03-31T15:29:38Z',
'fuel_type': 'diesel',
'id': '306bbd1c-6045-51dc-b03b-371b49b93991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR68015',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Audi',
'model': 'SQ5',
'odometer': 209716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_06b2e58a6639b09be6e5440a38206c00.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_4976ad24c94163aa1580ff188b124320.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a25b13bdebbc0e603cee39d159408190.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_7bc90eff0895a0d55ff6e5abcc5a8a97.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_bc0c9439287d3004a1226acca6c68413.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_d5d779a79e765a4a03ca94101ffa0ccc.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a98ad2cbee7eafec82be85b35cf6b298.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_6650580a53266322370e15dd148888b0.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_ceced134d0d3b7551b11be4fc7189d30.jpg',
'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_e471cbb81dbc0795a5095493e2ec3b0b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_06b2e58a6639b09be6e5440a38206c00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_4976ad24c94163aa1580ff188b124320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a25b13bdebbc0e603cee39d159408190.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_7bc90eff0895a0d55ff6e5abcc5a8a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_bc0c9439287d3004a1226acca6c68413.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_d5d779a79e765a4a03ca94101ffa0ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_a98ad2cbee7eafec82be85b35cf6b298.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_6650580a53266322370e15dd148888b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_ceced134d0d3b7551b11be4fc7189d30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306bbd1c-6045-51dc-b03b-371b49b93991/306bbd1c-6045-51dc-b03b-371b49b93991_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img26/d2/26d264d5a0a39c5838cdc9c71f5c9f97/pa/GR68015_e471cbb81dbc0795a5095493e2ec3b0b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR68015%27 HTTP/1.1" 200 None
2026-03-30 11:59:15 [auto1.fr] INFO: Saving data for GR68015: {'created_time': 1774871955.964897, 'last_price_update_time': 1774871955.964909, 'auction_closing_time': 1774970978.0}
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GR68015') HTTP/1.1" 204 0
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF40383> (referer: https://www.auto1.com/v1/car-details-view/BF40383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with identifier: BF40383
2026-03-30 11:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with scrape type 1
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_c929c5813bc3b4c930267d89749be6da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_c929c5813bc3b4c930267d89749be6da.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_522aa19010885950873426d54b792a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_522aa19010885950873426d54b792a8d.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_ea4dd4334417009b53414eb0fe2371e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_ea4dd4334417009b53414eb0fe2371e9.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_76a21975ac4142f0e95a1e2ee6992761.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_76a21975ac4142f0e95a1e2ee6992761.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg not downloaded yet
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_c929c5813bc3b4c930267d89749be6da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_522aa19010885950873426d54b792a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_1867f846f7db72480e52bd54c1048f43.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_1867f846f7db72480e52bd54c1048f43.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg not downloaded yet
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg not downloaded yet
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285135090>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_c929c5813bc3b4c930267d89749be6da.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_c929c5813bc3b4c930267d89749be6da.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b605d0>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_522aa19010885950873426d54b792a8d.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_522aa19010885950873426d54b792a8d.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_1867f846f7db72480e52bd54c1048f43.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_ea4dd4334417009b53414eb0fe2371e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_76a21975ac4142f0e95a1e2ee6992761.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285121510>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72868c5090>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72868c4850>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_1867f846f7db72480e52bd54c1048f43.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_1867f846f7db72480e52bd54c1048f43.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285120cd0>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_ea4dd4334417009b53414eb0fe2371e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_ea4dd4334417009b53414eb0fe2371e9.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c4e050>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg saved to cache
2026-03-30 11:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc3190>
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg saved to cache
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ad0150>
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg saved to cache
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287a47c10>
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F8e%252Fe78e2db2640096c646964cccfe15f9b3%252Fpa%252FBF40383_76a21975ac4142f0e95a1e2ee6992761.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_76a21975ac4142f0e95a1e2ee6992761.jpg saved to cache
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd
2026-03-30 11:59:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd, skipping ID generation
2026-03-30 11:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with scrape type 1
2026-03-30 11:59:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd sending to next pipeline
2026-03-30 11:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd, identifier: BF40383
2026-03-30 11:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with identifier: BF40383
2026-03-30 11:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with identifier: BF40383
2026-03-30 11:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd with identifier: BF40383 to the API
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_76a21975ac4142f0e95a1e2ee6992761.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 91,
'expiration_date': '2026-03-31T15:13:28Z',
'fuel_type': 'petrol',
'id': 'b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF40383',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Renault',
'model': 'Clio',
'odometer': 76877,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_c929c5813bc3b4c930267d89749be6da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_522aa19010885950873426d54b792a8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_ea4dd4334417009b53414eb0fe2371e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_eaf19dd50675b7a32b9a9b78d7ba31c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_76a21975ac4142f0e95a1e2ee6992761.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_9019bfcbd2d07552bcda94cab6c31cce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_3d28602e3d7e77f9a5917a348f5b7472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_1867f846f7db72480e52bd54c1048f43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_cbf0c9e5e9acc16d9a33a08e62d4393f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd/b9aafdc0-0bab-5b4c-8239-9a6dd41e40bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/8e/e78e2db2640096c646964cccfe15f9b3/pa/BF40383_e33e96c3cf16d34615eaa80f060b7ae6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.0 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2021}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF40383%27 HTTP/1.1" 200 None
2026-03-30 11:59:17 [auto1.fr] INFO: Saving data for BF40383: {'created_time': 1774871957.586067, 'last_price_update_time': 1774871957.586076, 'auction_closing_time': 1774970008.0}
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BF40383') HTTP/1.1" 204 0
2026-03-30 11:59:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.093(s), this was the 1st time calling it.
2026-03-30 11:59:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.632882193524413 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN25144> (referer: https://www.auto1.com/v1/car-details-view/UN25144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e498679-b483-511f-839d-4dc7e84ebb7e with identifier: UN25144
2026-03-30 11:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e498679-b483-511f-839d-4dc7e84ebb7e with scrape type 1
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_6afdabf49f286d61b569c69b148bc511.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_6afdabf49f286d61b569c69b148bc511.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_306c0991ccbe99af1869e31f07d4883d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_306c0991ccbe99af1869e31f07d4883d.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_4965f153dd7ee17b49832220fab44bbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_4965f153dd7ee17b49832220fab44bbc.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_7ee6dd29629bd2628744e05981b022b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_7ee6dd29629bd2628744e05981b022b4.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg not downloaded yet
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_6afdabf49f286d61b569c69b148bc511.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_306c0991ccbe99af1869e31f07d4883d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_e064ef9c5c710f55173facce0d45a44b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_e064ef9c5c710f55173facce0d45a44b.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_478b1e3f8e6a169143b05aa97a93c918.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_478b1e3f8e6a169143b05aa97a93c918.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg not downloaded yet
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg not downloaded yet
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_7ee6dd29629bd2628744e05981b022b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_4965f153dd7ee17b49832220fab44bbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ea810>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_6afdabf49f286d61b569c69b148bc511.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_6afdabf49f286d61b569c69b148bc511.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859f9910>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_306c0991ccbe99af1869e31f07d4883d.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_306c0991ccbe99af1869e31f07d4883d.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_478b1e3f8e6a169143b05aa97a93c918.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a5810>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_7ee6dd29629bd2628744e05981b022b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_7ee6dd29629bd2628744e05981b022b4.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b7910>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_4965f153dd7ee17b49832220fab44bbc.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_4965f153dd7ee17b49832220fab44bbc.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_e064ef9c5c710f55173facce0d45a44b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a03050>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a02990>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_478b1e3f8e6a169143b05aa97a93c918.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_478b1e3f8e6a169143b05aa97a93c918.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7288180590>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bffb50>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285146210>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_e064ef9c5c710f55173facce0d45a44b.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_e064ef9c5c710f55173facce0d45a44b.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a28e90>
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F70%252Fe670eac3fd398d784d4766749aaf4bbd%252Fpa%252FUN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg') HTTP/1.1" 204 0
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg saved to cache
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e498679-b483-511f-839d-4dc7e84ebb7e
2026-03-30 11:59:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e498679-b483-511f-839d-4dc7e84ebb7e, skipping ID generation
2026-03-30 11:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e498679-b483-511f-839d-4dc7e84ebb7e with scrape type 1
2026-03-30 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e498679-b483-511f-839d-4dc7e84ebb7e sending to next pipeline
2026-03-30 11:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e498679-b483-511f-839d-4dc7e84ebb7e, identifier: UN25144
2026-03-30 11:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e498679-b483-511f-839d-4dc7e84ebb7e with identifier: UN25144
2026-03-30 11:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e498679-b483-511f-839d-4dc7e84ebb7e with identifier: UN25144
2026-03-30 11:59:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e498679-b483-511f-839d-4dc7e84ebb7e with identifier: UN25144 to the API
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 305,
'expiration_date': '2026-03-31T15:08:28Z',
'fuel_type': 'diesel',
'id': '7e498679-b483-511f-839d-4dc7e84ebb7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN25144',
'listing': 'auction',
'location': 'FR, Montataire',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 111726,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_6afdabf49f286d61b569c69b148bc511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_306c0991ccbe99af1869e31f07d4883d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_4965f153dd7ee17b49832220fab44bbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_7ee6dd29629bd2628744e05981b022b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_82ba98d90c2be05ec9add2ae1eef32ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_e064ef9c5c710f55173facce0d45a44b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_b5ec8ea7ebd341391ed29079863d7f96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_478b1e3f8e6a169143b05aa97a93c918.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_ff052e31aa141a4bfadffa0a8e452a2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e498679-b483-511f-839d-4dc7e84ebb7e/7e498679-b483-511f-839d-4dc7e84ebb7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/70/e670eac3fd398d784d4766749aaf4bbd/pa/UN25144_579a7e6f281f46caa1147c4fb7e82bf2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2015}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN25144%27 HTTP/1.1" 200 None
2026-03-30 11:59:35 [auto1.fr] INFO: Saving data for UN25144: {'created_time': 1774871975.331542, 'last_price_update_time': 1774871975.331551, 'auction_closing_time': 1774969708.0}
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN25144') HTTP/1.1" 204 0
2026-03-30 11:59:58 [scrapy.extensions.logstats] INFO: Crawled 43 pages (at 6 pages/min), scraped 37 items (at 4 items/min)
2026-03-30 11:59:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 12:00:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.737(s), this was the 1st time calling it.
2026-03-30 12:00:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.137412821899739 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:00:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.958(s), this was the 1st time calling it.
2026-03-30 12:00:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.40091534273682 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:12 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: YF83787
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: MH87240
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: SS47680
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: YU56432
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: CU45750
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU45750%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.fr] INFO: Scrape type for CU45750: 0
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: PA03861
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: XR58587
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: UH13368
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: UA69734
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: FR85071
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: SU29093
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: GJ22585
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: FV06170
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV06170%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.fr] INFO: Scrape type for FV06170: 2
2026-03-30 12:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e703cff7-f8cc-5041-829f-5db0c4c2507f with identifier: FV06170
2026-03-30 12:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e703cff7-f8cc-5041-829f-5db0c4c2507f with scrape type 2
2026-03-30 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e703cff7-f8cc-5041-829f-5db0c4c2507f with scrape type 2
2026-03-30 12:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e703cff7-f8cc-5041-829f-5db0c4c2507f, identifier: FV06170
2026-03-30 12:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e703cff7-f8cc-5041-829f-5db0c4c2507f with identifier: FV06170
2026-03-30 12:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e703cff7-f8cc-5041-829f-5db0c4c2507f with identifier: FV06170
2026-03-30 12:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e703cff7-f8cc-5041-829f-5db0c4c2507f with identifier: FV06170 to the API
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:52:36Z',
'fuel_type': 'diesel',
'id': 'e703cff7-f8cc-5041-829f-5db0c4c2507f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV06170',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 158500,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-10',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 314 CDI RWD L2',
'transmission': 'manual',
'trim': 'RWD L2',
'year': 2021}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV06170%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Saving data for FV06170: {'auction_closing_time': 1774972356.0, 'created_time': 1773059492.225871, 'last_price_update_time': 1774872014.33567}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV06170') HTTP/1.1" 204 0
2026-03-30 12:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: PE02516
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: JM12134
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: PU97836
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: KV88888
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV88888%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Scrape type for KV88888: 1
2026-03-30 12:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: JN92343
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: YB12408
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB12408%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Scrape type for YB12408: 1
2026-03-30 12:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: BG54951
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: MC09972
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: DP81330
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: GL09785
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: PU51122
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: YW85128
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW85128%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Scrape type for YW85128: 2
2026-03-30 12:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbae290f-e202-55a9-b5d2-b0f104124b03 with identifier: YW85128
2026-03-30 12:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbae290f-e202-55a9-b5d2-b0f104124b03 with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbae290f-e202-55a9-b5d2-b0f104124b03 with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cbae290f-e202-55a9-b5d2-b0f104124b03, identifier: YW85128
2026-03-30 12:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cbae290f-e202-55a9-b5d2-b0f104124b03 with identifier: YW85128
2026-03-30 12:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cbae290f-e202-55a9-b5d2-b0f104124b03 with identifier: YW85128
2026-03-30 12:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cbae290f-e202-55a9-b5d2-b0f104124b03 with identifier: YW85128 to the API
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:43:22Z',
'fuel_type': 'diesel',
'id': 'cbae290f-e202-55a9-b5d2-b0f104124b03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW85128',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 238192,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-12',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Millenium',
'transmission': 'manual',
'trim': 'Millenium',
'year': 2016}
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW85128%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Saving data for YW85128: {'auction_closing_time': 1774971802.0, 'created_time': 1772817797.866163, 'last_price_update_time': 1774872020.769426}
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW85128') HTTP/1.1" 204 0
2026-03-30 12:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: UK53228
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: LF01831
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: FM80198
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: HL85627
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: NY25826
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY25826%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Scrape type for NY25826: 1
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: BJ69793
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: RK77632
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: MG57565
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: CM40964
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: VN88845
2026-03-30 12:00:20 [auto1.fr] INFO: Found listing with ID: ZB65239
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB65239%27 HTTP/1.1" 200 None
2026-03-30 12:00:20 [auto1.fr] INFO: Scrape type for ZB65239: 2
2026-03-30 12:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with identifier: ZB65239
2026-03-30 12:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with scrape type 2
2026-03-30 12:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with scrape type 2
2026-03-30 12:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 391bdfec-3456-5786-a1d8-fe3f0cec63b6, identifier: ZB65239
2026-03-30 12:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with identifier: ZB65239
2026-03-30 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with identifier: ZB65239
2026-03-30 12:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 391bdfec-3456-5786-a1d8-fe3f0cec63b6 with identifier: ZB65239 to the API
2026-03-30 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:49:35Z',
'fuel_type': 'diesel',
'id': '391bdfec-3456-5786-a1d8-fe3f0cec63b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB65239',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 281795,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-15',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi FT 280 K',
'transmission': 'manual',
'trim': 'FT 280 K',
'year': 2009}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB65239%27 HTTP/1.1" 200 None
2026-03-30 12:00:24 [auto1.fr] INFO: Saving data for ZB65239: {'auction_closing_time': 1774972175.0, 'created_time': 1774383373.740522, 'last_price_update_time': 1774872024.896349}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB65239') HTTP/1.1" 204 0
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: KV40050
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: HK32331
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: AM96995
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: HT52883
2026-03-30 12:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB12408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV88888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL46788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY25826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV88888> (referer: https://www.auto1.com/v1/car-details-view/KV88888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46 with identifier: KV88888
2026-03-30 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46 with scrape type 1
2026-03-30 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_4be2d7080a442fcbe92f6b7f742e1391.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4be2d7080a442fcbe92f6b7f742e1391.jpg already downloaded
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_dd015650ea2130b98a2b886c92aac141.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_dd015650ea2130b98a2b886c92aac141.jpg already downloaded
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_4f009a28ecaadd05aa100b718b65d730.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4f009a28ecaadd05aa100b718b65d730.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_b48b3a5f64c35536fbb6289b42b7d993.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b48b3a5f64c35536fbb6289b42b7d993.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_57c8a584f6586add1cc8fa444b64a42e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_57c8a584f6586add1cc8fa444b64a42e.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_729b29e82ebb49e82cb3bcf8fb3a031a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_729b29e82ebb49e82cb3bcf8fb3a031a.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_52104ca425d117435ed9e8bb3e8f50b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_52104ca425d117435ed9e8bb3e8f50b8.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_55399b6227d04186bc180e7adb834dfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_55399b6227d04186bc180e7adb834dfe.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_f3c7bbd64f1fa66328e4bafcb844f5eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_f3c7bbd64f1fa66328e4bafcb844f5eb.jpg already downloaded
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F2a%252Fe92acfb44158cb2faa49fb801db88bbb%252Fpa%252FKV88888_b873285d906060497e088e8908e10762.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b873285d906060497e088e8908e10762.jpg already downloaded
2026-03-30 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46, identifier: KV88888
2026-03-30 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46 with identifier: KV88888
2026-03-30 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46 with identifier: KV88888
2026-03-30 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e13e87e-3edb-5bf3-b26f-a0f318cc3d46 with identifier: KV88888 to the API
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV88888>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:24:03Z',
'fuel_type': 'petrol',
'id': '2e13e87e-3edb-5bf3-b26f-a0f318cc3d46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV88888',
'listing': 'auction',
'location': 'FR, LE HAVRE',
'make': 'BMW',
'model': '1er',
'odometer': 53007,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4be2d7080a442fcbe92f6b7f742e1391.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_dd015650ea2130b98a2b886c92aac141.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4f009a28ecaadd05aa100b718b65d730.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b48b3a5f64c35536fbb6289b42b7d993.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_57c8a584f6586add1cc8fa444b64a42e.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_729b29e82ebb49e82cb3bcf8fb3a031a.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_52104ca425d117435ed9e8bb3e8f50b8.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_55399b6227d04186bc180e7adb834dfe.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_f3c7bbd64f1fa66328e4bafcb844f5eb.jpg',
'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b873285d906060497e088e8908e10762.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4be2d7080a442fcbe92f6b7f742e1391.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2114146,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_dd015650ea2130b98a2b886c92aac141.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2274007,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_4f009a28ecaadd05aa100b718b65d730.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b48b3a5f64c35536fbb6289b42b7d993.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406528,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_57c8a584f6586add1cc8fa444b64a42e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2307497,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_729b29e82ebb49e82cb3bcf8fb3a031a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_52104ca425d117435ed9e8bb3e8f50b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2374709,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_55399b6227d04186bc180e7adb834dfe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2228967,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_f3c7bbd64f1fa66328e4bafcb844f5eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e13e87e-3edb-5bf3-b26f-a0f318cc3d46/2e13e87e-3edb-5bf3-b26f-a0f318cc3d46_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/2a/e92acfb44158cb2faa49fb801db88bbb/pa/KV88888_b873285d906060497e088e8908e10762.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118i Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2019}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV88888%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.fr] INFO: Saving data for KV88888: {'created_time': 1774872030.661096, 'last_price_update_time': 1774872030.661112, 'auction_closing_time': 1774970643.0}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV88888') HTTP/1.1" 204 0
2026-03-30 12:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:32 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 5682 | hits on page: 40
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: AM96995
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: HT52883
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: FH12619
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: DX08652
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: YY12321
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: BZ11243
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: MC30629
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: FA81163
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: KL53133
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: LD88363
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: AE60263
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: HJ00300
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ00300%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for HJ00300: 0
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: PU50032
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK35304%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for JK35304: 1
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN44721%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for MN44721: 1
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD74717%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for MD74717: 1
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW53663%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for UW53663: 1
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS72770%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for VS72770: 1
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: CN71105
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN71105%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for CN71105: 1
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: EF37210
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF37210%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for EF37210: 1
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: BR75524
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: BH81493
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: AC83389
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: RP10604
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: SY05693
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: LD59929
2026-03-30 12:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY25826> (referer: https://www.auto1.com/v1/car-details-view/NY25826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e441921-0990-5e65-9be9-c886f84372aa with identifier: NY25826
2026-03-30 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e441921-0990-5e65-9be9-c886f84372aa with scrape type 1
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e441921-0990-5e65-9be9-c886f84372aa
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_92122df5cffa338b10972011a39c6128.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_92122df5cffa338b10972011a39c6128.jpg already downloaded
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_8f8785bd040721709145a5a21e3d1802.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_8f8785bd040721709145a5a21e3d1802.jpg already downloaded
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_6ed3adb0bc560145d9fd19ab39362a64.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ed3adb0bc560145d9fd19ab39362a64.jpg already downloaded
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_6ab3cb5bf2892c91530c79a7dacfc187.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ab3cb5bf2892c91530c79a7dacfc187.jpg already downloaded
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_d1c94b8667c1e96de7dceb44403b597a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_d1c94b8667c1e96de7dceb44403b597a.jpg already downloaded
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa4%252F7ea4949c3e4e0bb94936ebf5a86f7ad1%252Fpa%252FNY25826_cc3268b138306d6e93f23523054065d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_cc3268b138306d6e93f23523054065d2.jpg already downloaded
2026-03-30 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e441921-0990-5e65-9be9-c886f84372aa, identifier: NY25826
2026-03-30 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e441921-0990-5e65-9be9-c886f84372aa with identifier: NY25826
2026-03-30 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e441921-0990-5e65-9be9-c886f84372aa with identifier: NY25826
2026-03-30 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e441921-0990-5e65-9be9-c886f84372aa with identifier: NY25826 to the API
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY25826>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:24:46Z',
'fuel_type': 'diesel',
'id': '7e441921-0990-5e65-9be9-c886f84372aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY25826',
'listing': 'auction',
'location': 'Chartres',
'make': 'Chevrolet',
'model': 'Orlando',
'odometer': 214042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_92122df5cffa338b10972011a39c6128.jpg',
'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_8f8785bd040721709145a5a21e3d1802.jpg',
'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ed3adb0bc560145d9fd19ab39362a64.jpg',
'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ab3cb5bf2892c91530c79a7dacfc187.jpg',
'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_d1c94b8667c1e96de7dceb44403b597a.jpg',
'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_cc3268b138306d6e93f23523054065d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_92122df5cffa338b10972011a39c6128.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_8f8785bd040721709145a5a21e3d1802.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ed3adb0bc560145d9fd19ab39362a64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_6ab3cb5bf2892c91530c79a7dacfc187.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_d1c94b8667c1e96de7dceb44403b597a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e441921-0990-5e65-9be9-c886f84372aa/7e441921-0990-5e65-9be9-c886f84372aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/a4/7ea4949c3e4e0bb94936ebf5a86f7ad1/pa/NY25826_cc3268b138306d6e93f23523054065d2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-25',
'seats_number': 7,
'seller_name': None,
'title': 'Chevrolet Orlando 2.0 Diesel LTZ',
'transmission': 'manual',
'trim': 'LTZ',
'year': 2011}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY25826%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.fr] INFO: Saving data for NY25826: {'created_time': 1774872035.397948, 'last_price_update_time': 1774872035.397959, 'auction_closing_time': 1774970686.0}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY25826') HTTP/1.1" 204 0
2026-03-30 12:00:35 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 5682 | hits on page: 40
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: XY40736
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: WS97350
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: TL58072
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: KX79018
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: BH39999
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: NH49785
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH49785%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.fr] INFO: Scrape type for NH49785: 2
2026-03-30 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with identifier: NH49785
2026-03-30 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee, identifier: NH49785
2026-03-30 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with identifier: NH49785
2026-03-30 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with identifier: NH49785
2026-03-30 12:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee with identifier: NH49785 to the API
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:51:46Z',
'fuel_type': 'diesel',
'id': '7f14bb76-e12a-5798-8dc5-cb6ec7ed1dee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH49785',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 160538,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-12',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Attraction 2WD',
'transmission': 'manual',
'trim': 'Attraction 2WD',
'year': 2015}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH49785%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Saving data for NH49785: {'auction_closing_time': 1774972306.0, 'created_time': 1774253448.629608, 'last_price_update_time': 1774872036.902994}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH49785') HTTP/1.1" 204 0
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: CV88444
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: NY83999
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: MC89388
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC89388%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Scrape type for MC89388: 2
2026-03-30 12:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5143c9b-3645-5faa-88b5-444e106bdfd4 with identifier: MC89388
2026-03-30 12:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5143c9b-3645-5faa-88b5-444e106bdfd4 with scrape type 2
2026-03-30 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5143c9b-3645-5faa-88b5-444e106bdfd4 with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a5143c9b-3645-5faa-88b5-444e106bdfd4, identifier: MC89388
2026-03-30 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a5143c9b-3645-5faa-88b5-444e106bdfd4 with identifier: MC89388
2026-03-30 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a5143c9b-3645-5faa-88b5-444e106bdfd4 with identifier: MC89388
2026-03-30 12:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a5143c9b-3645-5faa-88b5-444e106bdfd4 with identifier: MC89388 to the API
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:29:35Z',
'fuel_type': 'hybrid',
'id': 'a5143c9b-3645-5faa-88b5-444e106bdfd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC89388',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 136930,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC89388%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Saving data for MC89388: {'auction_closing_time': 1774970975.0, 'created_time': 1773675932.877544, 'last_price_update_time': 1774872037.385428}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC89388') HTTP/1.1" 204 0
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: EG50461
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: BU50680
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: PR53320
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: NT01211
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: SJ86891
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: GV14574
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: ZP24027
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: YP42607
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: CR02968
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: SD98356
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: CC91432
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: MF38303
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: WZ42856
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: ED93860
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: RW88857
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: UY14685
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: UN11275
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: LZ68007
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ68007%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Scrape type for LZ68007: 1
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: PY98810
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: GM21063
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: UM27725
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM27725%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Scrape type for UM27725: 2
2026-03-30 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27cac15-1d55-58a0-956d-318d68e47a3e with identifier: UM27725
2026-03-30 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27cac15-1d55-58a0-956d-318d68e47a3e with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a27cac15-1d55-58a0-956d-318d68e47a3e with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a27cac15-1d55-58a0-956d-318d68e47a3e, identifier: UM27725
2026-03-30 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a27cac15-1d55-58a0-956d-318d68e47a3e with identifier: UM27725
2026-03-30 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a27cac15-1d55-58a0-956d-318d68e47a3e with identifier: UM27725
2026-03-30 12:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a27cac15-1d55-58a0-956d-318d68e47a3e with identifier: UM27725 to the API
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:22:40Z',
'fuel_type': 'diesel',
'id': 'a27cac15-1d55-58a0-956d-318d68e47a3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM27725',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Aveo',
'odometer': 141769,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-02',
'seller_name': None,
'title': 'Chevrolet Aveo 1.3 Diesel LS +',
'transmission': 'manual',
'trim': 'LS +',
'year': 2013}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM27725%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Saving data for UM27725: {'auction_closing_time': 1774970560.0, 'created_time': 1774106102.518594, 'last_price_update_time': 1774872037.869283}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UM27725') HTTP/1.1" 204 0
2026-03-30 12:00:37 [auto1.fr] INFO: Found listing with ID: SZ69319
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ69319%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Scrape type for SZ69319: 2
2026-03-30 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with identifier: SZ69319
2026-03-30 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with scrape type 2
2026-03-30 12:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e4ae70b-759b-5d27-9c3c-c1facce86a48, identifier: SZ69319
2026-03-30 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with identifier: SZ69319
2026-03-30 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with identifier: SZ69319
2026-03-30 12:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e4ae70b-759b-5d27-9c3c-c1facce86a48 with identifier: SZ69319 to the API
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:23:33Z',
'fuel_type': 'petrol',
'id': '9e4ae70b-759b-5d27-9c3c-c1facce86a48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ69319',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 172607,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-31',
'seller_name': None,
'title': 'Renault Megane 1.6 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2007}
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ69319%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Saving data for SZ69319: {'auction_closing_time': 1774970613.0, 'created_time': 1773693588.96656, 'last_price_update_time': 1774872038.40571}
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SZ69319') HTTP/1.1" 204 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: PZ99671
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: NS29326
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: KY08586
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: CH55510
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: JG04823
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: JT52746
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: RC08561
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: YS81962
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: XL73746
2026-03-30 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN71105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS72770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:40 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 5683 | hits on page: 40
2026-03-30 12:00:40 [auto1.fr] INFO: Found listing with ID: XL73746
2026-03-30 12:00:40 [auto1.fr] INFO: Found listing with ID: SJ22403
2026-03-30 12:00:40 [auto1.fr] INFO: Found listing with ID: NW68535
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW68535%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Scrape type for NW68535: 2
2026-03-30 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae34cd71-d86d-5753-a9f4-3891efee7729 with identifier: NW68535
2026-03-30 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae34cd71-d86d-5753-a9f4-3891efee7729 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae34cd71-d86d-5753-a9f4-3891efee7729 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae34cd71-d86d-5753-a9f4-3891efee7729, identifier: NW68535
2026-03-30 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae34cd71-d86d-5753-a9f4-3891efee7729 with identifier: NW68535
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae34cd71-d86d-5753-a9f4-3891efee7729 with identifier: NW68535
2026-03-30 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae34cd71-d86d-5753-a9f4-3891efee7729 with identifier: NW68535 to the API
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 193,
'expiration_date': '2026-03-31T15:51:42Z',
'fuel_type': 'petrol',
'id': 'ae34cd71-d86d-5753-a9f4-3891efee7729',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW68535',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 139190,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-19',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW68535%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Saving data for NW68535: {'auction_closing_time': 1774972302.0, 'created_time': 1774124500.866345, 'last_price_update_time': 1774872040.974236}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW68535') HTTP/1.1" 204 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: KA64045
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: ZD89512
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: AG33226
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: EV69519
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: ZC47446
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: MH84462
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: FW05670
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: YV12989
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: NW87362
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: UY26535
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: NG50520
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: EJ12515
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: EB00923
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: AM99663
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: RV60833
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV60833%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for RV60833: 2
2026-03-30 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad1a8a94-e17f-5321-a504-5e83544a5b74 with identifier: RV60833
2026-03-30 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad1a8a94-e17f-5321-a504-5e83544a5b74 with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad1a8a94-e17f-5321-a504-5e83544a5b74 with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad1a8a94-e17f-5321-a504-5e83544a5b74, identifier: RV60833
2026-03-30 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad1a8a94-e17f-5321-a504-5e83544a5b74 with identifier: RV60833
2026-03-30 12:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad1a8a94-e17f-5321-a504-5e83544a5b74 with identifier: RV60833
2026-03-30 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad1a8a94-e17f-5321-a504-5e83544a5b74 with identifier: RV60833 to the API
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:30:55Z',
'fuel_type': 'diesel',
'id': 'ad1a8a94-e17f-5321-a504-5e83544a5b74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV60833',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 262990,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-21',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2011}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV60833%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Saving data for RV60833: {'auction_closing_time': 1774971055.0, 'created_time': 1774538369.362658, 'last_price_update_time': 1774872041.526574}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV60833') HTTP/1.1" 204 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: AK05387
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: ER68789
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: VE80756
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: GL02133
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: VX49143
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: FK23512
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: JN15401
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN15401%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for JN15401: 2
2026-03-30 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831f6775-374d-5185-97a4-7140c1c5acdb with identifier: JN15401
2026-03-30 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831f6775-374d-5185-97a4-7140c1c5acdb with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 831f6775-374d-5185-97a4-7140c1c5acdb with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 831f6775-374d-5185-97a4-7140c1c5acdb, identifier: JN15401
2026-03-30 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 831f6775-374d-5185-97a4-7140c1c5acdb with identifier: JN15401
2026-03-30 12:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 831f6775-374d-5185-97a4-7140c1c5acdb with identifier: JN15401
2026-03-30 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 831f6775-374d-5185-97a4-7140c1c5acdb with identifier: JN15401 to the API
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:04:27Z',
'fuel_type': 'diesel',
'id': '831f6775-374d-5185-97a4-7140c1c5acdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN15401',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso',
'odometer': 121842,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-22',
'seller_name': None,
'title': 'Toyota Verso 1.6 D-4D Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN15401%27 HTTP/1.1" 200 None
2026-03-30 12:00:42 [auto1.fr] INFO: Saving data for JN15401: {'auction_closing_time': 1774969467.0, 'created_time': 1774124535.371386, 'last_price_update_time': 1774872042.130724}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN15401') HTTP/1.1" 204 0
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: CX38977
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: SV36178
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: DS08848
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: TA72470
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: VV44439
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: BH32555
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: GP66779
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP66779%27 HTTP/1.1" 200 None
2026-03-30 12:00:42 [auto1.fr] INFO: Scrape type for GP66779: 2
2026-03-30 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab2b748-853e-5d62-9f62-05763fc39356 with identifier: GP66779
2026-03-30 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab2b748-853e-5d62-9f62-05763fc39356 with scrape type 2
2026-03-30 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cab2b748-853e-5d62-9f62-05763fc39356 with scrape type 2
2026-03-30 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cab2b748-853e-5d62-9f62-05763fc39356, identifier: GP66779
2026-03-30 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cab2b748-853e-5d62-9f62-05763fc39356 with identifier: GP66779
2026-03-30 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cab2b748-853e-5d62-9f62-05763fc39356 with identifier: GP66779
2026-03-30 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cab2b748-853e-5d62-9f62-05763fc39356 with identifier: GP66779 to the API
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:31:00Z',
'fuel_type': 'diesel',
'id': 'cab2b748-853e-5d62-9f62-05763fc39356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP66779',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 168172,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-02',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Airplay',
'transmission': 'manual',
'trim': 'Airplay',
'year': 2008}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP66779%27 HTTP/1.1" 200 None
2026-03-30 12:00:42 [auto1.fr] INFO: Saving data for GP66779: {'auction_closing_time': 1774971060.0, 'created_time': 1774124023.802453, 'last_price_update_time': 1774872042.595471}
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP66779') HTTP/1.1" 204 0
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: CY28334
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: LU64065
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: TJ82128
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: WN55034
2026-03-30 12:00:42 [auto1.fr] INFO: Found listing with ID: KD15134
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD15134%27 HTTP/1.1" 200 None
2026-03-30 12:00:42 [auto1.fr] INFO: Scrape type for KD15134: 2
2026-03-30 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad42cb4f-fd5a-50ac-a666-779705692fd6 with identifier: KD15134
2026-03-30 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad42cb4f-fd5a-50ac-a666-779705692fd6 with scrape type 2
2026-03-30 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad42cb4f-fd5a-50ac-a666-779705692fd6 with scrape type 2
2026-03-30 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad42cb4f-fd5a-50ac-a666-779705692fd6, identifier: KD15134
2026-03-30 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad42cb4f-fd5a-50ac-a666-779705692fd6 with identifier: KD15134
2026-03-30 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad42cb4f-fd5a-50ac-a666-779705692fd6 with identifier: KD15134
2026-03-30 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad42cb4f-fd5a-50ac-a666-779705692fd6 with identifier: KD15134 to the API
2026-03-30 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:47:51Z',
'fuel_type': 'diesel',
'id': 'ad42cb4f-fd5a-50ac-a666-779705692fd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD15134',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 89758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-29',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD15134%27 HTTP/1.1" 200 None
2026-03-30 12:00:43 [auto1.fr] INFO: Saving data for KD15134: {'auction_closing_time': 1774972071.0, 'created_time': 1774106022.180015, 'last_price_update_time': 1774872043.184}
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD15134') HTTP/1.1" 204 0
2026-03-30 12:00:43 [auto1.fr] INFO: Found listing with ID: PU79516
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU79516%27 HTTP/1.1" 200 None
2026-03-30 12:00:43 [auto1.fr] INFO: Scrape type for PU79516: 2
2026-03-30 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with identifier: PU79516
2026-03-30 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with scrape type 2
2026-03-30 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with scrape type 2
2026-03-30 12:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef, identifier: PU79516
2026-03-30 12:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with identifier: PU79516
2026-03-30 12:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with identifier: PU79516
2026-03-30 12:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5ec68ae5-30ba-5c95-b2c5-c9492adf69ef with identifier: PU79516 to the API
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:06:16Z',
'fuel_type': 'diesel',
'id': '5ec68ae5-30ba-5c95-b2c5-c9492adf69ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU79516',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-29',
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
'transmission': 'automatic',
'trim': 'Super',
'year': 2016}
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU79516%27 HTTP/1.1" 200 None
2026-03-30 12:00:43 [auto1.fr] INFO: Saving data for PU79516: {'auction_closing_time': 1774969576.0, 'created_time': 1774557760.134015, 'last_price_update_time': 1774872043.653784}
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU79516') HTTP/1.1" 204 0
2026-03-30 12:00:43 [auto1.fr] INFO: Found listing with ID: CW34956
2026-03-30 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF37210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ68007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS72770> (referer: https://www.auto1.com/v1/car-details-view/VS72770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0333b485-a5e9-5f34-b323-4355ebc26fa2 with identifier: VS72770
2026-03-30 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0333b485-a5e9-5f34-b323-4355ebc26fa2 with scrape type 1
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0333b485-a5e9-5f34-b323-4355ebc26fa2
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_8a12fa6e7a2c88675a5e509b3d13469d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_8a12fa6e7a2c88675a5e509b3d13469d.jpg already downloaded
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_6060b24b2e837162bb205b465eee028d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_6060b24b2e837162bb205b465eee028d.jpg already downloaded
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_fb5c62b8e3b950178ce24739b2619464.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_fb5c62b8e3b950178ce24739b2619464.jpg already downloaded
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_41f204c94af1e17630f3205ff3c577a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_41f204c94af1e17630f3205ff3c577a1.jpg already downloaded
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_05f5ee508e4ebe5fe6d6c9f4983e1df4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_05f5ee508e4ebe5fe6d6c9f4983e1df4.jpg already downloaded
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F26%252Fd4265848019b5fe3acea2a8fe1cdc07c%252Fpa%252FVS72770_319866154fdec630f8774b4917f8be71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_319866154fdec630f8774b4917f8be71.jpg already downloaded
2026-03-30 12:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0333b485-a5e9-5f34-b323-4355ebc26fa2, identifier: VS72770
2026-03-30 12:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0333b485-a5e9-5f34-b323-4355ebc26fa2 with identifier: VS72770
2026-03-30 12:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0333b485-a5e9-5f34-b323-4355ebc26fa2 with identifier: VS72770
2026-03-30 12:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0333b485-a5e9-5f34-b323-4355ebc26fa2 with identifier: VS72770 to the API
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS72770>
{'auction_title': '',
'c_o_2_emission_value': 1,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:17:47Z',
'fuel_type': 'petrol',
'id': '0333b485-a5e9-5f34-b323-4355ebc26fa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS72770',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Peugeot',
'model': '208',
'odometer': 172640,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_8a12fa6e7a2c88675a5e509b3d13469d.jpg',
'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_6060b24b2e837162bb205b465eee028d.jpg',
'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_fb5c62b8e3b950178ce24739b2619464.jpg',
'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_41f204c94af1e17630f3205ff3c577a1.jpg',
'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_05f5ee508e4ebe5fe6d6c9f4983e1df4.jpg',
'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_319866154fdec630f8774b4917f8be71.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_8a12fa6e7a2c88675a5e509b3d13469d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_6060b24b2e837162bb205b465eee028d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_fb5c62b8e3b950178ce24739b2619464.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_41f204c94af1e17630f3205ff3c577a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_05f5ee508e4ebe5fe6d6c9f4983e1df4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333b485-a5e9-5f34-b323-4355ebc26fa2/0333b485-a5e9-5f34-b323-4355ebc26fa2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/26/d4265848019b5fe3acea2a8fe1cdc07c/pa/VS72770_319866154fdec630f8774b4917f8be71.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS72770%27 HTTP/1.1" 200 None
2026-03-30 12:00:45 [auto1.fr] INFO: Saving data for VS72770: {'created_time': 1774872045.929877, 'last_price_update_time': 1774872045.92989, 'auction_closing_time': 1774970267.0}
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS72770') HTTP/1.1" 204 0
2026-03-30 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL46788> (referer: https://www.auto1.com/v1/car-details-view/WL46788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a602463d-3d06-55b1-97b6-6bf18d5714d3 with identifier: WL46788
2026-03-30 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a602463d-3d06-55b1-97b6-6bf18d5714d3 with scrape type 1
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a602463d-3d06-55b1-97b6-6bf18d5714d3
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_cf4483d44d12f07b49a6cbe999994e96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_cf4483d44d12f07b49a6cbe999994e96.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_13fa6936879c512baba6bbfc8c74ee4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_13fa6936879c512baba6bbfc8c74ee4c.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_3882d0095cf722a3197904c445c8d4f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3882d0095cf722a3197904c445c8d4f6.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_b8f1a8eb86c14241d9b2c1ce697d0803.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_b8f1a8eb86c14241d9b2c1ce697d0803.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_ac132d45ccf3d02e32e8f3ef3850d25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_ac132d45ccf3d02e32e8f3ef3850d25f.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_05c22fdf76cf29a67116d6eaa90ea153.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_05c22fdf76cf29a67116d6eaa90ea153.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_3c4eb4e378bb00c91b16f5f9b91570e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3c4eb4e378bb00c91b16f5f9b91570e3.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_d20263b2190786526d58e45e1ce580b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_d20263b2190786526d58e45e1ce580b3.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_5ee9b3e6affba3e17666cbb258bad373.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5ee9b3e6affba3e17666cbb258bad373.jpg already downloaded
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fb7%252F06b7384fa92a33242bb0fd9066f752a9%252Fpa%252FWL46788_5c2dc1c25331f9225a21ce1245498bf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5c2dc1c25331f9225a21ce1245498bf6.jpg already downloaded
2026-03-30 12:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a602463d-3d06-55b1-97b6-6bf18d5714d3, identifier: WL46788
2026-03-30 12:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a602463d-3d06-55b1-97b6-6bf18d5714d3 with identifier: WL46788
2026-03-30 12:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a602463d-3d06-55b1-97b6-6bf18d5714d3 with identifier: WL46788
2026-03-30 12:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a602463d-3d06-55b1-97b6-6bf18d5714d3 with identifier: WL46788 to the API
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL46788>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:50:51Z',
'fuel_type': 'petrol',
'id': 'a602463d-3d06-55b1-97b6-6bf18d5714d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL46788',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Ford',
'model': 'Kuga',
'odometer': 174799,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_cf4483d44d12f07b49a6cbe999994e96.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_13fa6936879c512baba6bbfc8c74ee4c.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3882d0095cf722a3197904c445c8d4f6.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_b8f1a8eb86c14241d9b2c1ce697d0803.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_ac132d45ccf3d02e32e8f3ef3850d25f.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_05c22fdf76cf29a67116d6eaa90ea153.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3c4eb4e378bb00c91b16f5f9b91570e3.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_d20263b2190786526d58e45e1ce580b3.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5ee9b3e6affba3e17666cbb258bad373.jpg',
'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5c2dc1c25331f9225a21ce1245498bf6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_cf4483d44d12f07b49a6cbe999994e96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_13fa6936879c512baba6bbfc8c74ee4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2259637,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3882d0095cf722a3197904c445c8d4f6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_b8f1a8eb86c14241d9b2c1ce697d0803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_ac132d45ccf3d02e32e8f3ef3850d25f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_05c22fdf76cf29a67116d6eaa90ea153.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_3c4eb4e378bb00c91b16f5f9b91570e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_d20263b2190786526d58e45e1ce580b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5ee9b3e6affba3e17666cbb258bad373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a602463d-3d06-55b1-97b6-6bf18d5714d3/a602463d-3d06-55b1-97b6-6bf18d5714d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/b7/06b7384fa92a33242bb0fd9066f752a9/pa/WL46788_5c2dc1c25331f9225a21ce1245498bf6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-30 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL46788%27 HTTP/1.1" 200 None
2026-03-30 12:00:47 [auto1.fr] INFO: Saving data for WL46788: {'created_time': 1774872047.265429, 'last_price_update_time': 1774872047.26544, 'auction_closing_time': 1774972251.0}
2026-03-30 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WL46788') HTTP/1.1" 204 0
2026-03-30 12:00:58 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 16 pages/min), scraped 54 items (at 17 items/min)
2026-03-30 12:00:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN71105> (referer: https://www.auto1.com/v1/car-details-view/CN71105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93315296-4dc2-5470-bb07-2f71c9bb47fb with identifier: CN71105
2026-03-30 12:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93315296-4dc2-5470-bb07-2f71c9bb47fb with scrape type 1
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93315296-4dc2-5470-bb07-2f71c9bb47fb
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_b610fc22111531ea75f31c561b2c1fd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_b610fc22111531ea75f31c561b2c1fd9.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_532780b49d7e0ccbd326432955a43abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_532780b49d7e0ccbd326432955a43abb.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_9abcc6f1a547c36cb6ecd77192f24287.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_9abcc6f1a547c36cb6ecd77192f24287.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_d4cdf88377aeb2f73b548dff51d09c61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_d4cdf88377aeb2f73b548dff51d09c61.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_55f22918fb8ebd561503d1be18c064e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_55f22918fb8ebd561503d1be18c064e3.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_611a0633b63feba16a6a0b2debc72e28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_611a0633b63feba16a6a0b2debc72e28.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_f2577fdc41813d99e92e32f670890fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f2577fdc41813d99e92e32f670890fea.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_8ef57c3998acdabfb2c8c9aabc5be6e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_8ef57c3998acdabfb2c8c9aabc5be6e8.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_ac4220dee34194f14b2f118879cdb265.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_ac4220dee34194f14b2f118879cdb265.jpg already downloaded
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F5b%252F515b649ef79da0725a35768897be592a%252Fpa%252FCN71105_f49df5150aff9aba3533b8cb0cecba3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f49df5150aff9aba3533b8cb0cecba3c.jpg already downloaded
2026-03-30 12:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93315296-4dc2-5470-bb07-2f71c9bb47fb, identifier: CN71105
2026-03-30 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93315296-4dc2-5470-bb07-2f71c9bb47fb with identifier: CN71105
2026-03-30 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93315296-4dc2-5470-bb07-2f71c9bb47fb with identifier: CN71105
2026-03-30 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93315296-4dc2-5470-bb07-2f71c9bb47fb with identifier: CN71105 to the API
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN71105>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:28:27Z',
'fuel_type': 'diesel',
'id': '93315296-4dc2-5470-bb07-2f71c9bb47fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN71105',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 342328,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_b610fc22111531ea75f31c561b2c1fd9.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_532780b49d7e0ccbd326432955a43abb.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_9abcc6f1a547c36cb6ecd77192f24287.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_d4cdf88377aeb2f73b548dff51d09c61.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_55f22918fb8ebd561503d1be18c064e3.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_611a0633b63feba16a6a0b2debc72e28.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f2577fdc41813d99e92e32f670890fea.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_8ef57c3998acdabfb2c8c9aabc5be6e8.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_ac4220dee34194f14b2f118879cdb265.jpg',
'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f49df5150aff9aba3533b8cb0cecba3c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_b610fc22111531ea75f31c561b2c1fd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_532780b49d7e0ccbd326432955a43abb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_9abcc6f1a547c36cb6ecd77192f24287.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_d4cdf88377aeb2f73b548dff51d09c61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_55f22918fb8ebd561503d1be18c064e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_611a0633b63feba16a6a0b2debc72e28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2436582,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f2577fdc41813d99e92e32f670890fea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_8ef57c3998acdabfb2c8c9aabc5be6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_ac4220dee34194f14b2f118879cdb265.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93315296-4dc2-5470-bb07-2f71c9bb47fb/93315296-4dc2-5470-bb07-2f71c9bb47fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2814652,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/5b/515b649ef79da0725a35768897be592a/pa/CN71105_f49df5150aff9aba3533b8cb0cecba3c.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-11',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2015}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN71105%27 HTTP/1.1" 200 None
2026-03-30 12:01:03 [auto1.fr] INFO: Saving data for CN71105: {'created_time': 1774872063.68953, 'last_price_update_time': 1774872063.689545, 'auction_closing_time': 1774970907.0}
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN71105') HTTP/1.1" 204 0
2026-03-30 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF37210> (referer: https://www.auto1.com/v1/car-details-view/EF37210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3 with identifier: EF37210
2026-03-30 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3 with scrape type 1
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_adab6eeb56aa70f778cfac6e47f90705.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_adab6eeb56aa70f778cfac6e47f90705.jpg already downloaded
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_293230475d2d1dd757f1a4741ae2c6de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_293230475d2d1dd757f1a4741ae2c6de.jpg already downloaded
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_e490f44f15a9c26f7065e0462e0d329c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_e490f44f15a9c26f7065e0462e0d329c.jpg already downloaded
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_54f6b7b85eea74a7ca772a36cae4a4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_54f6b7b85eea74a7ca772a36cae4a4eb.jpg already downloaded
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_332f685bf6caec36c894bdc1c65f05db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_332f685bf6caec36c894bdc1c65f05db.jpg already downloaded
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F7f%252F227f25c9304829b9c9c54817c4fcecf1%252Fpa%252FEF37210_d84f5a45f6f3818c77b753e51328f313.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_d84f5a45f6f3818c77b753e51328f313.jpg already downloaded
2026-03-30 12:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3, identifier: EF37210
2026-03-30 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3 with identifier: EF37210
2026-03-30 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 12:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3 with identifier: EF37210
2026-03-30 12:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3 with identifier: EF37210 to the API
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF37210>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:48:06Z',
'fuel_type': 'gas',
'id': 'ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF37210',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Dacia',
'model': 'Duster',
'odometer': 244492,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_adab6eeb56aa70f778cfac6e47f90705.jpg',
'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_293230475d2d1dd757f1a4741ae2c6de.jpg',
'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_e490f44f15a9c26f7065e0462e0d329c.jpg',
'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_54f6b7b85eea74a7ca772a36cae4a4eb.jpg',
'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_332f685bf6caec36c894bdc1c65f05db.jpg',
'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_d84f5a45f6f3818c77b753e51328f313.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_adab6eeb56aa70f778cfac6e47f90705.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_293230475d2d1dd757f1a4741ae2c6de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_e490f44f15a9c26f7065e0462e0d329c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_54f6b7b85eea74a7ca772a36cae4a4eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_332f685bf6caec36c894bdc1c65f05db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3/ceb17797-fbe4-5e3f-b6be-315d4f3ef2b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/7f/227f25c9304829b9c9c54817c4fcecf1/pa/EF37210_d84f5a45f6f3818c77b753e51328f313.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.6 E85 4x2',
'transmission': 'manual',
'trim': '4x2',
'year': 2011}
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF37210%27 HTTP/1.1" 200 None
2026-03-30 12:01:13 [auto1.fr] INFO: Saving data for EF37210: {'created_time': 1774872073.458225, 'last_price_update_time': 1774872073.458236, 'auction_closing_time': 1774972086.0}
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF37210') HTTP/1.1" 204 0
2026-03-30 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ68007> (referer: https://www.auto1.com/v1/car-details-view/LZ68007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 721b0a5a-8195-5f0d-be6f-b1ed7bae7567 with identifier: LZ68007
2026-03-30 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 721b0a5a-8195-5f0d-be6f-b1ed7bae7567 with scrape type 1
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 721b0a5a-8195-5f0d-be6f-b1ed7bae7567
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_af45c66fa7cb115396f64a24a56e048e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_af45c66fa7cb115396f64a24a56e048e.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_c58f2c8788f2a99b674a50509e9607bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_c58f2c8788f2a99b674a50509e9607bf.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_010742ac845d69ff6bda9e9ce6acab18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_010742ac845d69ff6bda9e9ce6acab18.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_16129e9189eb6b442e49bea4da2f4571.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_16129e9189eb6b442e49bea4da2f4571.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_6074306aad84e99dd2400d0c4e5869ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_6074306aad84e99dd2400d0c4e5869ff.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_40bf4a7c71319f030e9c970bec478622.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_40bf4a7c71319f030e9c970bec478622.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_da8d9d43cbb9c196ec684e7c310a2838.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_da8d9d43cbb9c196ec684e7c310a2838.jpg already downloaded
2026-03-30 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_93a0252cbfbfb10516cda1825979b718.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_93a0252cbfbfb10516cda1825979b718.jpg already downloaded
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_f4ecf2997480ac835a147d7cc4b3f68c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_f4ecf2997480ac835a147d7cc4b3f68c.jpg already downloaded
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fe3%252F3ce357e9078fb41aaf8e98e2217e4513%252Fpa%252FLZ68007_5deb2ee9447464719679082ea096202c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_5deb2ee9447464719679082ea096202c.jpg already downloaded
2026-03-30 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 721b0a5a-8195-5f0d-be6f-b1ed7bae7567, identifier: LZ68007
2026-03-30 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 721b0a5a-8195-5f0d-be6f-b1ed7bae7567 with identifier: LZ68007
2026-03-30 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 721b0a5a-8195-5f0d-be6f-b1ed7bae7567 with identifier: LZ68007
2026-03-30 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 721b0a5a-8195-5f0d-be6f-b1ed7bae7567 with identifier: LZ68007 to the API
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ68007>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:13:46Z',
'fuel_type': 'diesel',
'id': '721b0a5a-8195-5f0d-be6f-b1ed7bae7567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ68007',
'listing': 'auction',
'location': 'Chartres',
'make': 'Peugeot',
'model': '5008',
'odometer': 168724,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_af45c66fa7cb115396f64a24a56e048e.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_c58f2c8788f2a99b674a50509e9607bf.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_010742ac845d69ff6bda9e9ce6acab18.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_16129e9189eb6b442e49bea4da2f4571.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_6074306aad84e99dd2400d0c4e5869ff.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_40bf4a7c71319f030e9c970bec478622.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_da8d9d43cbb9c196ec684e7c310a2838.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_93a0252cbfbfb10516cda1825979b718.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_f4ecf2997480ac835a147d7cc4b3f68c.jpg',
'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_5deb2ee9447464719679082ea096202c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_af45c66fa7cb115396f64a24a56e048e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_c58f2c8788f2a99b674a50509e9607bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_010742ac845d69ff6bda9e9ce6acab18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_16129e9189eb6b442e49bea4da2f4571.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_6074306aad84e99dd2400d0c4e5869ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_40bf4a7c71319f030e9c970bec478622.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_da8d9d43cbb9c196ec684e7c310a2838.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_93a0252cbfbfb10516cda1825979b718.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_f4ecf2997480ac835a147d7cc4b3f68c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_721b0a5a-8195-5f0d-be6f-b1ed7bae7567/721b0a5a-8195-5f0d-be6f-b1ed7bae7567_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e3/3ce357e9078fb41aaf8e98e2217e4513/pa/LZ68007_5deb2ee9447464719679082ea096202c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-10',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2018}
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ68007%27 HTTP/1.1" 200 None
2026-03-30 12:01:16 [auto1.fr] INFO: Saving data for LZ68007: {'created_time': 1774872076.487135, 'last_price_update_time': 1774872076.487147, 'auction_closing_time': 1774970026.0}
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ68007') HTTP/1.1" 204 0
2026-03-30 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:21 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 5685 | hits on page: 40
2026-03-30 12:01:21 [auto1.fr] INFO: Found listing with ID: PU79516
2026-03-30 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU79516%27 HTTP/1.1" 200 None
2026-03-30 12:01:21 [auto1.fr] INFO: Scrape type for PU79516: 0
2026-03-30 12:01:21 [auto1.fr] INFO: Found listing with ID: CW34956
2026-03-30 12:01:21 [auto1.fr] INFO: Found listing with ID: JX23289
2026-03-30 12:01:21 [auto1.fr] INFO: Found listing with ID: ZS17982
2026-03-30 12:01:21 [auto1.fr] INFO: Found listing with ID: CZ48020
2026-03-30 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ48020%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Scrape type for CZ48020: 1
2026-03-30 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: CJ41818
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: LM46920
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: UA34003
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA34003%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Scrape type for UA34003: 1
2026-03-30 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: TV16458
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: BZ85729
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: PK34456
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: RR47118
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: ZD92785
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD92785%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Scrape type for ZD92785: 1
2026-03-30 12:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: MB27463
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: ZD67967
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD67967%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Scrape type for ZD67967: 2
2026-03-30 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86acde0a-89ba-5637-b83a-2a9b73556a1d with identifier: ZD67967
2026-03-30 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86acde0a-89ba-5637-b83a-2a9b73556a1d with scrape type 2
2026-03-30 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86acde0a-89ba-5637-b83a-2a9b73556a1d with scrape type 2
2026-03-30 12:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 86acde0a-89ba-5637-b83a-2a9b73556a1d, identifier: ZD67967
2026-03-30 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 86acde0a-89ba-5637-b83a-2a9b73556a1d with identifier: ZD67967
2026-03-30 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 86acde0a-89ba-5637-b83a-2a9b73556a1d with identifier: ZD67967
2026-03-30 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 86acde0a-89ba-5637-b83a-2a9b73556a1d with identifier: ZD67967 to the API
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:32:47Z',
'fuel_type': 'diesel',
'id': '86acde0a-89ba-5637-b83a-2a9b73556a1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD67967',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 249480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-03',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Business +',
'transmission': 'manual',
'trim': 'Business +',
'year': 2013}
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD67967%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Saving data for ZD67967: {'auction_closing_time': 1774971167.0, 'created_time': 1774439153.580726, 'last_price_update_time': 1774872082.543518}
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD67967') HTTP/1.1" 204 0
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: YP72685
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: MR68962
2026-03-30 12:01:22 [auto1.fr] INFO: Found listing with ID: GH19552
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH19552%27 HTTP/1.1" 200 None
2026-03-30 12:01:22 [auto1.fr] INFO: Scrape type for GH19552: 2
2026-03-30 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36510f65-af8a-5795-8cc1-1d558d831f84 with identifier: GH19552
2026-03-30 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36510f65-af8a-5795-8cc1-1d558d831f84 with scrape type 2
2026-03-30 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36510f65-af8a-5795-8cc1-1d558d831f84 with scrape type 2
2026-03-30 12:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36510f65-af8a-5795-8cc1-1d558d831f84, identifier: GH19552
2026-03-30 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36510f65-af8a-5795-8cc1-1d558d831f84 with identifier: GH19552
2026-03-30 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36510f65-af8a-5795-8cc1-1d558d831f84 with identifier: GH19552
2026-03-30 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36510f65-af8a-5795-8cc1-1d558d831f84 with identifier: GH19552 to the API
2026-03-30 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:31:28Z',
'fuel_type': 'petrol',
'id': '36510f65-af8a-5795-8cc1-1d558d831f84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH19552',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 153548,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-24',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2018}
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH19552%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Saving data for GH19552: {'auction_closing_time': 1774971088.0, 'created_time': 1772948292.724659, 'last_price_update_time': 1774872083.153306}
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GH19552') HTTP/1.1" 204 0
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: DS36987
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: AL67797
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: BV40330
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV40330%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Scrape type for BV40330: 1
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: LW97985
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: CH34160
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: VU62913
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU62913%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Scrape type for VU62913: 2
2026-03-30 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-03-30 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with scrape type 2
2026-03-30 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with scrape type 2
2026-03-30 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69, identifier: VU62913
2026-03-30 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-03-30 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913
2026-03-30 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c80d4ccf-8729-5e65-8cb5-c57c3f9cef69 with identifier: VU62913 to the API
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:10Z',
'fuel_type': 'diesel',
'id': 'c80d4ccf-8729-5e65-8cb5-c57c3f9cef69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU62913',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 158232,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-20',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU62913%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Saving data for VU62913: {'auction_closing_time': 1774970710.0, 'created_time': 1773674029.396814, 'last_price_update_time': 1774872083.72318}
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU62913') HTTP/1.1" 204 0
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: LH64935
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: MB54534
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB54534%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Scrape type for MB54534: 0
2026-03-30 12:01:23 [auto1.fr] INFO: Found listing with ID: ZZ76181
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ76181%27 HTTP/1.1" 200 None
2026-03-30 12:01:23 [auto1.fr] INFO: Scrape type for ZZ76181: 2
2026-03-30 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 543e00ce-1e37-5a6c-93c2-c187601ac40c with identifier: ZZ76181
2026-03-30 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543e00ce-1e37-5a6c-93c2-c187601ac40c with scrape type 2
2026-03-30 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 543e00ce-1e37-5a6c-93c2-c187601ac40c with scrape type 2
2026-03-30 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 543e00ce-1e37-5a6c-93c2-c187601ac40c, identifier: ZZ76181
2026-03-30 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 543e00ce-1e37-5a6c-93c2-c187601ac40c with identifier: ZZ76181
2026-03-30 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 543e00ce-1e37-5a6c-93c2-c187601ac40c with identifier: ZZ76181
2026-03-30 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 543e00ce-1e37-5a6c-93c2-c187601ac40c with identifier: ZZ76181 to the API
2026-03-30 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:31:02Z',
'fuel_type': 'diesel',
'id': '543e00ce-1e37-5a6c-93c2-c187601ac40c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ76181',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 216077,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-27',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 280 L1 Trend',
'transmission': 'manual',
'trim': '280 L1 Trend',
'year': 2019}
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ76181%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Saving data for ZZ76181: {'auction_closing_time': 1774971062.0, 'created_time': 1773251816.553535, 'last_price_update_time': 1774872084.418988}
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZZ76181') HTTP/1.1" 204 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: RD23036
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: XZ61201
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: XR77162
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: KZ21626
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ21626%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for KZ21626: 0
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: WA74710
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: MZ88866
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: AJ87343
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ87343%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for AJ87343: 1
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: HL88307
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: VA96032
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: LL20734
2026-03-30 12:01:24 [auto1.fr] INFO: Found listing with ID: VN69868
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN69868%27 HTTP/1.1" 200 None
2026-03-30 12:01:24 [auto1.fr] INFO: Scrape type for VN69868: 2
2026-03-30 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb380205-7644-5f22-b8a7-5260fd52ea81 with identifier: VN69868
2026-03-30 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb380205-7644-5f22-b8a7-5260fd52ea81 with scrape type 2
2026-03-30 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb380205-7644-5f22-b8a7-5260fd52ea81 with scrape type 2
2026-03-30 12:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb380205-7644-5f22-b8a7-5260fd52ea81, identifier: VN69868
2026-03-30 12:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb380205-7644-5f22-b8a7-5260fd52ea81 with identifier: VN69868
2026-03-30 12:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb380205-7644-5f22-b8a7-5260fd52ea81 with identifier: VN69868
2026-03-30 12:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb380205-7644-5f22-b8a7-5260fd52ea81 with identifier: VN69868 to the API
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:17:02Z',
'fuel_type': 'diesel',
'id': 'cb380205-7644-5f22-b8a7-5260fd52ea81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN69868',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 168220,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Express Grand Confort L1',
'transmission': 'manual',
'trim': 'Express Grand Confort L1',
'year': 2020}
2026-03-30 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN69868%27 HTTP/1.1" 200 None
2026-03-30 12:01:25 [auto1.fr] INFO: Saving data for VN69868: {'auction_closing_time': 1774970222.0, 'created_time': 1774525365.769417, 'last_price_update_time': 1774872085.042134}
2026-03-30 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN69868') HTTP/1.1" 204 0
2026-03-30 12:01:25 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 12:01:25 [auto1.fr] INFO: Found listing with ID: TR16969
2026-03-30 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:32 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 5687 | hits on page: 40
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: TR16969
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: US48890
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: SV11482
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: AX27193
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX27193%27 HTTP/1.1" 200 None
2026-03-30 12:01:32 [auto1.fr] INFO: Scrape type for AX27193: 2
2026-03-30 12:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b573795-fe5c-55bd-a04d-183b084293f9 with identifier: AX27193
2026-03-30 12:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b573795-fe5c-55bd-a04d-183b084293f9 with scrape type 2
2026-03-30 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b573795-fe5c-55bd-a04d-183b084293f9 with scrape type 2
2026-03-30 12:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b573795-fe5c-55bd-a04d-183b084293f9, identifier: AX27193
2026-03-30 12:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b573795-fe5c-55bd-a04d-183b084293f9 with identifier: AX27193
2026-03-30 12:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b573795-fe5c-55bd-a04d-183b084293f9 with identifier: AX27193
2026-03-30 12:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b573795-fe5c-55bd-a04d-183b084293f9 with identifier: AX27193 to the API
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-31T15:36:01Z',
'fuel_type': 'petrol',
'id': '1b573795-fe5c-55bd-a04d-183b084293f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX27193',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Kalos',
'odometer': 136444,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-28',
'seller_name': None,
'title': 'Chevrolet Kalos 1.2 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2007}
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX27193%27 HTTP/1.1" 200 None
2026-03-30 12:01:32 [auto1.fr] INFO: Saving data for AX27193: {'auction_closing_time': 1774971361.0, 'created_time': 1774296853.075495, 'last_price_update_time': 1774872092.968012}
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX27193') HTTP/1.1" 204 0
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: GZ22446
2026-03-30 12:01:32 [auto1.fr] INFO: Found listing with ID: TW15870
2026-03-30 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW15870%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for TW15870: 1
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: XH52609
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: XC78678
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: CR01658
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: KB47626
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: FC26231
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: NB97574
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: EX66754
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: LW54010
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: CS58382
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS58382%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for CS58382: 2
2026-03-30 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with identifier: CS58382
2026-03-30 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with scrape type 2
2026-03-30 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with scrape type 2
2026-03-30 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3, identifier: CS58382
2026-03-30 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with identifier: CS58382
2026-03-30 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with identifier: CS58382
2026-03-30 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3 with identifier: CS58382 to the API
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:36:50Z',
'fuel_type': 'diesel',
'id': 'ee5b5c68-6422-5ef3-8b5a-2d4aef4ae0c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS58382',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 137595,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-04',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Edition',
'transmission': 'manual',
'trim': 'BlueEfficiency Edition',
'year': 2017}
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS58382%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Saving data for CS58382: {'auction_closing_time': 1774971410.0, 'created_time': 1772616773.271663, 'last_price_update_time': 1774872093.483755}
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS58382') HTTP/1.1" 204 0
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: AW86317
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: AL79561
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: CR50273
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: VG72144
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: WB58919
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: AZ00821
2026-03-30 12:01:33 [auto1.fr] INFO: Found listing with ID: GA93481
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA93481%27 HTTP/1.1" 200 None
2026-03-30 12:01:33 [auto1.fr] INFO: Scrape type for GA93481: 2
2026-03-30 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with identifier: GA93481
2026-03-30 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with scrape type 2
2026-03-30 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with scrape type 2
2026-03-30 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e11dfbb-f0e6-5a34-96bd-196fcb175b82, identifier: GA93481
2026-03-30 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with identifier: GA93481
2026-03-30 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with identifier: GA93481
2026-03-30 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e11dfbb-f0e6-5a34-96bd-196fcb175b82 with identifier: GA93481 to the API
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:02:39Z',
'fuel_type': 'diesel',
'id': '3e11dfbb-f0e6-5a34-96bd-196fcb175b82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA93481',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 131212,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-25',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Fascination',
'transmission': 'automatic',
'trim': 'Fascination',
'year': 2018}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA93481%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Saving data for GA93481: {'auction_closing_time': 1774969359.0, 'created_time': 1774438925.886975, 'last_price_update_time': 1774872094.057587}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA93481') HTTP/1.1" 204 0
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: UC26972
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC26972%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Scrape type for UC26972: 2
2026-03-30 12:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af0ca9ff-0c76-595a-963e-c952e5c57ed6 with identifier: UC26972
2026-03-30 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af0ca9ff-0c76-595a-963e-c952e5c57ed6 with scrape type 2
2026-03-30 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af0ca9ff-0c76-595a-963e-c952e5c57ed6 with scrape type 2
2026-03-30 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af0ca9ff-0c76-595a-963e-c952e5c57ed6, identifier: UC26972
2026-03-30 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af0ca9ff-0c76-595a-963e-c952e5c57ed6 with identifier: UC26972
2026-03-30 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af0ca9ff-0c76-595a-963e-c952e5c57ed6 with identifier: UC26972
2026-03-30 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af0ca9ff-0c76-595a-963e-c952e5c57ed6 with identifier: UC26972 to the API
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:12:32Z',
'fuel_type': 'petrol',
'id': 'af0ca9ff-0c76-595a-963e-c952e5c57ed6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC26972',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 44864,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2021}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC26972%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Saving data for UC26972: {'auction_closing_time': 1774969952.0, 'created_time': 1774296928.500374, 'last_price_update_time': 1774872094.546975}
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC26972') HTTP/1.1" 204 0
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: NH21299
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: CP39299
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: WS13608
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: PU29197
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU29197%27 HTTP/1.1" 200 None
2026-03-30 12:01:34 [auto1.fr] INFO: Scrape type for PU29197: 1
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: XT72733
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: LF56944
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: UH12185
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: DZ81197
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: MA18623
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: TC25097
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: WV40426
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: KP00368
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: KJ96172
2026-03-30 12:01:34 [auto1.fr] INFO: Found listing with ID: VP01929
2026-03-30 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD92785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA34003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV40330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ87343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW15870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:01:58 [scrapy.extensions.logstats] INFO: Crawled 69 pages (at 10 pages/min), scraped 66 items (at 12 items/min)
2026-03-30 12:01:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 12:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU29197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD92785> (referer: https://www.auto1.com/v1/car-details-view/ZD92785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278ff673-8206-5872-b306-c0489b2c6632 with identifier: ZD92785
2026-03-30 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278ff673-8206-5872-b306-c0489b2c6632 with scrape type 1
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_2f10598feb55c79a0299a6f44efb34fd.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_2f10598feb55c79a0299a6f44efb34fd.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_e2c890be152f133b9dd6afd79fa5003c.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_e2c890be152f133b9dd6afd79fa5003c.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_5cd12783ef7321092a7234cc48f20f34.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5cd12783ef7321092a7234cc48f20f34.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_8895c228878fce537ed43e72b9d0f85a.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_8895c228878fce537ed43e72b9d0f85a.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_28c04d74171df8039b5c823dfe3769a7.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_28c04d74171df8039b5c823dfe3769a7.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_5da21f3cce23a4edee92f7e31e230796.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5da21f3cce23a4edee92f7e31e230796.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_559a0753d25c9d07d8b04faa0310185c.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_559a0753d25c9d07d8b04faa0310185c.png not downloaded yet
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_7ab30e7f72c0c388e081a85baa6b5118.png%27 HTTP/1.1" 200 None
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_7ab30e7f72c0c388e081a85baa6b5118.png not downloaded yet
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_2f10598feb55c79a0299a6f44efb34fd.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_7ab30e7f72c0c388e081a85baa6b5118.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5cd12783ef7321092a7234cc48f20f34.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5da21f3cce23a4edee92f7e31e230796.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a07950>
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_1.png HTTP/1.1" 201 0
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png') HTTP/1.1" 204 0
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png saved to cache
2026-03-30 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_28c04d74171df8039b5c823dfe3769a7.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:03 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:02:03 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c04110>
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_0.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_2f10598feb55c79a0299a6f44efb34fd.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_2f10598feb55c79a0299a6f44efb34fd.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ff510>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_9.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_7ab30e7f72c0c388e081a85baa6b5118.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_7ab30e7f72c0c388e081a85baa6b5118.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b4510>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_3.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_5cd12783ef7321092a7234cc48f20f34.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5cd12783ef7321092a7234cc48f20f34.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850f1e50>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_7.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_5da21f3cce23a4edee92f7e31e230796.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5da21f3cce23a4edee92f7e31e230796.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a9b910>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_6.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_28c04d74171df8039b5c823dfe3769a7.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_28c04d74171df8039b5c823dfe3769a7.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_8895c228878fce537ed43e72b9d0f85a.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_559a0753d25c9d07d8b04faa0310185c.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_e2c890be152f133b9dd6afd79fa5003c.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png> (referer: https://www.auto1.com/)
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b30450>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_5.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_8895c228878fce537ed43e72b9d0f85a.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_8895c228878fce537ed43e72b9d0f85a.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287d971d0>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_8.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_559a0753d25c9d07d8b04faa0310185c.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_559a0753d25c9d07d8b04faa0310185c.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA34003> (referer: https://www.auto1.com/v1/car-details-view/UA34003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fd190>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_2.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_e2c890be152f133b9dd6afd79fa5003c.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_e2c890be152f133b9dd6afd79fa5003c.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:02:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf6f50>
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_4.png HTTP/1.1" 201 0
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F27%252Fe627282044f6f444e92a2c4423d418ff%252Fpa%252FZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png') HTTP/1.1" 204 0
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png saved to cache
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 278ff673-8206-5872-b306-c0489b2c6632
2026-03-30 12:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 278ff673-8206-5872-b306-c0489b2c6632, skipping ID generation
2026-03-30 12:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278ff673-8206-5872-b306-c0489b2c6632 with scrape type 1
2026-03-30 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 278ff673-8206-5872-b306-c0489b2c6632 sending to next pipeline
2026-03-30 12:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 278ff673-8206-5872-b306-c0489b2c6632, identifier: ZD92785
2026-03-30 12:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 278ff673-8206-5872-b306-c0489b2c6632 with identifier: ZD92785
2026-03-30 12:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 278ff673-8206-5872-b306-c0489b2c6632 with identifier: ZD92785
2026-03-30 12:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 278ff673-8206-5872-b306-c0489b2c6632 with identifier: ZD92785 to the API
2026-03-30 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:20:45Z',
'fuel_type': 'petrol',
'id': '278ff673-8206-5872-b306-c0489b2c6632',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD92785',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 13130,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 1038731,
'Height': 578,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_2f10598feb55c79a0299a6f44efb34fd.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_aec69f48c5cc7da15c60b33b62cd54cd.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 1110532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_e2c890be152f133b9dd6afd79fa5003c.png',
'Width': 795},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 610528,
'Height': 537,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5cd12783ef7321092a7234cc48f20f34.png',
'Width': 732},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 1004650,
'Height': 646,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_dc7d5f3f3823c498e2b37c0c850b2d55.png',
'Width': 871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 923278,
'Height': 643,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_8895c228878fce537ed43e72b9d0f85a.png',
'Width': 865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_28c04d74171df8039b5c823dfe3769a7.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_5da21f3cce23a4edee92f7e31e230796.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 801166,
'Height': 543,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_559a0753d25c9d07d8b04faa0310185c.png',
'Width': 745},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278ff673-8206-5872-b306-c0489b2c6632/278ff673-8206-5872-b306-c0489b2c6632_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/imge6/27/e627282044f6f444e92a2c4423d418ff/pa/ZD92785_7ab30e7f72c0c388e081a85baa6b5118.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD92785%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [auto1.fr] INFO: Saving data for ZD92785: {'created_time': 1774872125.613759, 'last_price_update_time': 1774872125.613769, 'auction_closing_time': 1774970445.0}
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD92785') HTTP/1.1" 204 0
2026-03-30 12:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca055504-2b54-5cf7-b537-6740c0d1f1d1 with identifier: UA34003
2026-03-30 12:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca055504-2b54-5cf7-b537-6740c0d1f1d1 with scrape type 1
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg not downloaded yet
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg not downloaded yet
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg not downloaded yet
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_830395c629795e7dfbf9130115088aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_830395c629795e7dfbf9130115088aa9.jpg not downloaded yet
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_9524edd0233654589c4ca114adebeab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_9524edd0233654589c4ca114adebeab6.jpg not downloaded yet
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_8a657243f77d6965ce5b73390acb994f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_8a657243f77d6965ce5b73390acb994f.jpg not downloaded yet
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_8a657243f77d6965ce5b73390acb994f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_830395c629795e7dfbf9130115088aa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b0090>
2026-03-30 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6be50>
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a3610>
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d0410>
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_8a657243f77d6965ce5b73390acb994f.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_8a657243f77d6965ce5b73390acb994f.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c65010>
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_830395c629795e7dfbf9130115088aa9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_830395c629795e7dfbf9130115088aa9.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_9524edd0233654589c4ca114adebeab6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac0b50>
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Faf%252F9aaf787afadeda75fd92261c33a6fca6%252Fpa%252FUA34003_9524edd0233654589c4ca114adebeab6.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_9524edd0233654589c4ca114adebeab6.jpg saved to cache
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca055504-2b54-5cf7-b537-6740c0d1f1d1
2026-03-30 12:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca055504-2b54-5cf7-b537-6740c0d1f1d1, skipping ID generation
2026-03-30 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca055504-2b54-5cf7-b537-6740c0d1f1d1 with scrape type 1
2026-03-30 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca055504-2b54-5cf7-b537-6740c0d1f1d1 sending to next pipeline
2026-03-30 12:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca055504-2b54-5cf7-b537-6740c0d1f1d1, identifier: UA34003
2026-03-30 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca055504-2b54-5cf7-b537-6740c0d1f1d1 with identifier: UA34003
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca055504-2b54-5cf7-b537-6740c0d1f1d1 with identifier: UA34003
2026-03-30 12:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca055504-2b54-5cf7-b537-6740c0d1f1d1 with identifier: UA34003 to the API
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_9524edd0233654589c4ca114adebeab6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:00:38Z',
'fuel_type': 'petrol',
'id': 'ca055504-2b54-5cf7-b537-6740c0d1f1d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA34003',
'listing': 'auction',
'location': 'FR, Chambray-Lès-Tours',
'make': 'Fiat',
'model': '500',
'odometer': 131613,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_73b62ffa9232b8b03cb5a4d399309a64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_c89a673fea7b10406aa4cb3e4fd4bdc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_fbd9c51d4043b256769faa3cd2e3bfbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_830395c629795e7dfbf9130115088aa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_9524edd0233654589c4ca114adebeab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca055504-2b54-5cf7-b537-6740c0d1f1d1/ca055504-2b54-5cf7-b537-6740c0d1f1d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/af/9aaf787afadeda75fd92261c33a6fca6/pa/UA34003_8a657243f77d6965ce5b73390acb994f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-10-24',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA34003%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Saving data for UA34003: {'created_time': 1774872126.99966, 'last_price_update_time': 1774872126.999673, 'auction_closing_time': 1774969238.0}
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA34003') HTTP/1.1" 204 0
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV40330> (referer: https://www.auto1.com/v1/car-details-view/BV40330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07b1b5d1-90c9-5447-ae79-6c156ca91efa with identifier: BV40330
2026-03-30 12:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa with scrape type 1
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_1819c933e1f548c7f2f36caf91a3104a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_1819c933e1f548c7f2f36caf91a3104a.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_ba89eedbd603d0670597deb86195e28b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_ba89eedbd603d0670597deb86195e28b.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_c93259d36d792d4167a64e428b75c9ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_c93259d36d792d4167a64e428b75c9ab.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_066f6e43604e7f8d043d17ca61476933.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_066f6e43604e7f8d043d17ca61476933.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_458372b2612521797e1ca86ae3f84dc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_458372b2612521797e1ca86ae3f84dc3.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_29e969599ba8f029cfa96e8d2b151f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_29e969599ba8f029cfa96e8d2b151f61.jpg not downloaded yet
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_f7488a245ab1fae5b063d3c017955d50.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_f7488a245ab1fae5b063d3c017955d50.jpg not downloaded yet
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_ba89eedbd603d0670597deb86195e28b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_c93259d36d792d4167a64e428b75c9ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_29e969599ba8f029cfa96e8d2b151f61.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0df50>
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_ba89eedbd603d0670597deb86195e28b.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_ba89eedbd603d0670597deb86195e28b.jpg saved to cache
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285141d50>
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg saved to cache
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_f7488a245ab1fae5b063d3c017955d50.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a11d0>
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_c93259d36d792d4167a64e428b75c9ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_c93259d36d792d4167a64e428b75c9ab.jpg saved to cache
2026-03-30 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287ccc590>
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dd190>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_29e969599ba8f029cfa96e8d2b151f61.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_29e969599ba8f029cfa96e8d2b151f61.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cd9150>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_066f6e43604e7f8d043d17ca61476933.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_458372b2612521797e1ca86ae3f84dc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a01450>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_f7488a245ab1fae5b063d3c017955d50.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_f7488a245ab1fae5b063d3c017955d50.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_1819c933e1f548c7f2f36caf91a3104a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859f8150>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_066f6e43604e7f8d043d17ca61476933.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_066f6e43604e7f8d043d17ca61476933.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac2810>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_458372b2612521797e1ca86ae3f84dc3.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_458372b2612521797e1ca86ae3f84dc3.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cca110>
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F2c%252F3c2c18e61c5e9687fefbce93f3a2dfdf%252Fpa%252FBV40330_1819c933e1f548c7f2f36caf91a3104a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_1819c933e1f548c7f2f36caf91a3104a.jpg saved to cache
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa
2026-03-30 12:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07b1b5d1-90c9-5447-ae79-6c156ca91efa, skipping ID generation
2026-03-30 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa with scrape type 1
2026-03-30 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07b1b5d1-90c9-5447-ae79-6c156ca91efa sending to next pipeline
2026-03-30 12:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 07b1b5d1-90c9-5447-ae79-6c156ca91efa, identifier: BV40330
2026-03-30 12:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 07b1b5d1-90c9-5447-ae79-6c156ca91efa with identifier: BV40330
2026-03-30 12:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 07b1b5d1-90c9-5447-ae79-6c156ca91efa with identifier: BV40330
2026-03-30 12:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 07b1b5d1-90c9-5447-ae79-6c156ca91efa with identifier: BV40330 to the API
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_1819c933e1f548c7f2f36caf91a3104a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:13:35Z',
'fuel_type': 'diesel',
'id': '07b1b5d1-90c9-5447-ae79-6c156ca91efa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV40330',
'listing': 'auction',
'location': 'FR, Sarreguemines',
'make': 'Audi',
'model': 'A4',
'odometer': 212423,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3263754,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_3c5933ae26e8ddf67d49ddcc5181a91d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3318167,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_1819c933e1f548c7f2f36caf91a3104a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_878bc3e067a4c74b0cb70b6fefb67f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_ba89eedbd603d0670597deb86195e28b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_c93259d36d792d4167a64e428b75c9ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_066f6e43604e7f8d043d17ca61476933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2963643,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_81f89ef51d2b8b97676f00dd7f7e74e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_458372b2612521797e1ca86ae3f84dc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_29e969599ba8f029cfa96e8d2b151f61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b1b5d1-90c9-5447-ae79-6c156ca91efa/07b1b5d1-90c9-5447-ae79-6c156ca91efa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/2c/3c2c18e61c5e9687fefbce93f3a2dfdf/pa/BV40330_f7488a245ab1fae5b063d3c017955d50.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-30 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV40330%27 HTTP/1.1" 200 None
2026-03-30 12:02:11 [auto1.fr] INFO: Saving data for BV40330: {'created_time': 1774872131.043862, 'last_price_update_time': 1774872131.043874, 'auction_closing_time': 1774970015.0}
2026-03-30 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BV40330') HTTP/1.1" 204 0
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ87343> (referer: https://www.auto1.com/v1/car-details-view/AJ87343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4eecb75-92e2-5ab6-b1b6-178148137bf6 with identifier: AJ87343
2026-03-30 12:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4eecb75-92e2-5ab6-b1b6-178148137bf6 with scrape type 1
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_93032ea26a344c41b1a17344532bfd5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_93032ea26a344c41b1a17344532bfd5f.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_d8c82ba633aca18a522e97648b48aec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_d8c82ba633aca18a522e97648b48aec2.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_97761667e0299989c9884daa21543657.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_97761667e0299989c9884daa21543657.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg not downloaded yet
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg not downloaded yet
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg not downloaded yet
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg not downloaded yet
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_d8c82ba633aca18a522e97648b48aec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_93032ea26a344c41b1a17344532bfd5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72851564d0>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ffe90>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c72310>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_d8c82ba633aca18a522e97648b48aec2.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_d8c82ba633aca18a522e97648b48aec2.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b31f10>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a3690>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c26510>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_93032ea26a344c41b1a17344532bfd5f.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_93032ea26a344c41b1a17344532bfd5f.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b68590>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285102b90>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg saved to cache
2026-03-30 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_97761667e0299989c9884daa21543657.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b0a90>
2026-03-30 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_97761667e0299989c9884daa21543657.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_97761667e0299989c9884daa21543657.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512dbd0>
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa3%252F9da33861bce2e306b33dc225641018b8%252Fpa%252FAJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg saved to cache
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4eecb75-92e2-5ab6-b1b6-178148137bf6
2026-03-30 12:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4eecb75-92e2-5ab6-b1b6-178148137bf6, skipping ID generation
2026-03-30 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4eecb75-92e2-5ab6-b1b6-178148137bf6 with scrape type 1
2026-03-30 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4eecb75-92e2-5ab6-b1b6-178148137bf6 sending to next pipeline
2026-03-30 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4eecb75-92e2-5ab6-b1b6-178148137bf6, identifier: AJ87343
2026-03-30 12:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4eecb75-92e2-5ab6-b1b6-178148137bf6 with identifier: AJ87343
2026-03-30 12:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4eecb75-92e2-5ab6-b1b6-178148137bf6 with identifier: AJ87343
2026-03-30 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b4eecb75-92e2-5ab6-b1b6-178148137bf6 with identifier: AJ87343 to the API
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:38:56Z',
'fuel_type': 'petrol',
'id': 'b4eecb75-92e2-5ab6-b1b6-178148137bf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ87343',
'listing': 'auction',
'location': 'FR, Sens',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 183307,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_2b49e2cfd4a4dbd891fc87e4d3bdbca5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2214297,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_93032ea26a344c41b1a17344532bfd5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_d8c82ba633aca18a522e97648b48aec2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_c3b54e87c9bf8f7f192bb0d26560e570.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_e8b4d0011ca22bc1d4a3b28d47c86764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2121366,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_97761667e0299989c9884daa21543657.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_30c450167baf9fda6ca0d8287ba7e91a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2330043,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_5f89e9510fe22d3169cfa276d7a43bc3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_9678469ed8a43e6e20cb3ac7a5d8c1a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4eecb75-92e2-5ab6-b1b6-178148137bf6/b4eecb75-92e2-5ab6-b1b6-178148137bf6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a3/9da33861bce2e306b33dc225641018b8/pa/AJ87343_77e9dbf6ef778835e66b26de2cbe79b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-29',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ87343%27 HTTP/1.1" 200 None
2026-03-30 12:02:13 [auto1.fr] INFO: Saving data for AJ87343: {'created_time': 1774872133.701497, 'last_price_update_time': 1774872133.701508, 'auction_closing_time': 1774971536.0}
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AJ87343') HTTP/1.1" 204 0
2026-03-30 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:14 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: KP00368
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: KJ96172
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: VP01929
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: DN93409
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: ZT48297
2026-03-30 12:02:14 [auto1.fr] INFO: Found listing with ID: JV70859
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV70859%27 HTTP/1.1" 200 None
2026-03-30 12:02:14 [auto1.fr] INFO: Scrape type for JV70859: 2
2026-03-30 12:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with identifier: JV70859
2026-03-30 12:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with scrape type 2
2026-03-30 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with scrape type 2
2026-03-30 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0f7a578-eb72-52b2-8ee0-5d7cedebed5d, identifier: JV70859
2026-03-30 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with identifier: JV70859
2026-03-30 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with identifier: JV70859
2026-03-30 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0f7a578-eb72-52b2-8ee0-5d7cedebed5d with identifier: JV70859 to the API
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:05:10Z',
'fuel_type': 'petrol',
'id': 'd0f7a578-eb72-52b2-8ee0-5d7cedebed5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV70859',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 209015,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-08',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI Sportline',
'transmission': 'automatic',
'trim': 'Sportline',
'year': 2009}
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV70859%27 HTTP/1.1" 200 None
2026-03-30 12:02:15 [auto1.fr] INFO: Saving data for JV70859: {'auction_closing_time': 1774969510.0, 'created_time': 1773076143.34285, 'last_price_update_time': 1774872135.648444}
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV70859') HTTP/1.1" 204 0
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: XH92136
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: NT04558
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: BB11849
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: XK65376
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: LY92555
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: YU12489
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: ZN46810
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN46810%27 HTTP/1.1" 200 None
2026-03-30 12:02:15 [auto1.fr] INFO: Scrape type for ZN46810: 1
2026-03-30 12:02:15 [auto1.fr] INFO: Found listing with ID: LW10952
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW10952%27 HTTP/1.1" 200 None
2026-03-30 12:02:15 [auto1.fr] INFO: Scrape type for LW10952: 2
2026-03-30 12:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295a960e-0514-5f46-9dca-5386539f5342 with identifier: LW10952
2026-03-30 12:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295a960e-0514-5f46-9dca-5386539f5342 with scrape type 2
2026-03-30 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295a960e-0514-5f46-9dca-5386539f5342 with scrape type 2
2026-03-30 12:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 295a960e-0514-5f46-9dca-5386539f5342, identifier: LW10952
2026-03-30 12:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 295a960e-0514-5f46-9dca-5386539f5342 with identifier: LW10952
2026-03-30 12:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 295a960e-0514-5f46-9dca-5386539f5342 with identifier: LW10952
2026-03-30 12:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 295a960e-0514-5f46-9dca-5386539f5342 with identifier: LW10952 to the API
2026-03-30 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 193,
'expiration_date': '2026-03-31T15:39:24Z',
'fuel_type': 'petrol',
'id': '295a960e-0514-5f46-9dca-5386539f5342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW10952',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 327774,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-11-11',
'seller_name': None,
'title': 'BMW 5er 528i',
'transmission': 'automatic',
'trim': '',
'year': 1997}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW10952%27 HTTP/1.1" 200 None
2026-03-30 12:02:16 [auto1.fr] INFO: Saving data for LW10952: {'auction_closing_time': 1774971564.0, 'created_time': 1772128185.421265, 'last_price_update_time': 1774872136.247964}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW10952') HTTP/1.1" 204 0
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: LT66464
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: LW75647
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: YJ52141
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: KR46154
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: YK40789
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: EY54413
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: LZ23013
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ23013%27 HTTP/1.1" 200 None
2026-03-30 12:02:16 [auto1.fr] INFO: Scrape type for LZ23013: 2
2026-03-30 12:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with identifier: LZ23013
2026-03-30 12:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with scrape type 2
2026-03-30 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with scrape type 2
2026-03-30 12:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fff411cf-4cc4-53b8-a0ac-be19fc4e4734, identifier: LZ23013
2026-03-30 12:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with identifier: LZ23013
2026-03-30 12:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with identifier: LZ23013
2026-03-30 12:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fff411cf-4cc4-53b8-a0ac-be19fc4e4734 with identifier: LZ23013 to the API
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:14:24Z',
'fuel_type': 'diesel',
'id': 'fff411cf-4cc4-53b8-a0ac-be19fc4e4734',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ23013',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 121466,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-21',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ23013%27 HTTP/1.1" 200 None
2026-03-30 12:02:16 [auto1.fr] INFO: Saving data for LZ23013: {'auction_closing_time': 1774970064.0, 'created_time': 1774439306.867862, 'last_price_update_time': 1774872136.799044}
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ23013') HTTP/1.1" 204 0
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: RA80092
2026-03-30 12:02:16 [auto1.fr] INFO: Found listing with ID: FJ82721
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ82721%27 HTTP/1.1" 200 None
2026-03-30 12:02:16 [auto1.fr] INFO: Scrape type for FJ82721: 2
2026-03-30 12:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with identifier: FJ82721
2026-03-30 12:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with scrape type 2
2026-03-30 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with scrape type 2
2026-03-30 12:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91818ff4-76f4-5bd0-8ef3-be6dacda5823, identifier: FJ82721
2026-03-30 12:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with identifier: FJ82721
2026-03-30 12:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with identifier: FJ82721
2026-03-30 12:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91818ff4-76f4-5bd0-8ef3-be6dacda5823 with identifier: FJ82721 to the API
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:19:33Z',
'fuel_type': 'petrol',
'id': '91818ff4-76f4-5bd0-8ef3-be6dacda5823',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ82721',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 105490,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-07',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Rip Curl',
'transmission': 'automatic',
'trim': 'Rip Curl',
'year': 2019}
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ82721%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Saving data for FJ82721: {'auction_closing_time': 1774970373.0, 'created_time': 1774439320.721978, 'last_price_update_time': 1774872137.273654}
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ82721') HTTP/1.1" 204 0
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: KU85731
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU85731%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for KU85731: 1
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: YG09777
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: XC64901
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: GD84445
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: CN95140
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN95140%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for CN95140: 1
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: LJ04008
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ04008%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for LJ04008: 1
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: TF16696
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: KK63519
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK63519%27 HTTP/1.1" 200 None
2026-03-30 12:02:17 [auto1.fr] INFO: Scrape type for KK63519: 1
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: RL53733
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: UG05877
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: YS05560
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: KP55875
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: EB66083
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: XG43753
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: KE63825
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: FV31615
2026-03-30 12:02:17 [auto1.fr] INFO: Found listing with ID: GU57901
2026-03-30 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW15870> (referer: https://www.auto1.com/v1/car-details-view/TW15870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea52a23-a59e-5ff5-a269-f162e5363158 with identifier: TW15870
2026-03-30 12:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea52a23-a59e-5ff5-a269-f162e5363158 with scrape type 1
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_c57331bbbaa1d809028d292f1403945f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c57331bbbaa1d809028d292f1403945f.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_13daef328d83627512249bc45cb8f70c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_13daef328d83627512249bc45cb8f70c.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_42555de7d840aa282a50767ac48c04d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_42555de7d840aa282a50767ac48c04d7.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg not downloaded yet
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c57331bbbaa1d809028d292f1403945f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_affe7134e5d00adc90f84d5476ca46be.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_affe7134e5d00adc90f84d5476ca46be.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_5972084cf841726756879d830b2f7864.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_5972084cf841726756879d830b2f7864.jpg not downloaded yet
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_696b50ee12292c77f06249ce7934e7d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_696b50ee12292c77f06249ce7934e7d0.jpg not downloaded yet
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a13ed0>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_c57331bbbaa1d809028d292f1403945f.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c57331bbbaa1d809028d292f1403945f.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a99a10>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_13daef328d83627512249bc45cb8f70c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc72d0>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_affe7134e5d00adc90f84d5476ca46be.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850788d0>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b64150>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_13daef328d83627512249bc45cb8f70c.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_13daef328d83627512249bc45cb8f70c.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dfc50>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_affe7134e5d00adc90f84d5476ca46be.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_affe7134e5d00adc90f84d5476ca46be.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_696b50ee12292c77f06249ce7934e7d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_5972084cf841726756879d830b2f7864.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ab1d0>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg saved to cache
2026-03-30 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_42555de7d840aa282a50767ac48c04d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a2050>
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_696b50ee12292c77f06249ce7934e7d0.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_696b50ee12292c77f06249ce7934e7d0.jpg saved to cache
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dc590>
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_5972084cf841726756879d830b2f7864.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_5972084cf841726756879d830b2f7864.jpg saved to cache
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728510bdd0>
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F1b%252Fbf1be8535bb17e5ab326100b6b48ca52%252Fpa%252FTW15870_42555de7d840aa282a50767ac48c04d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_42555de7d840aa282a50767ac48c04d7.jpg saved to cache
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ea52a23-a59e-5ff5-a269-f162e5363158
2026-03-30 12:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ea52a23-a59e-5ff5-a269-f162e5363158, skipping ID generation
2026-03-30 12:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea52a23-a59e-5ff5-a269-f162e5363158 with scrape type 1
2026-03-30 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ea52a23-a59e-5ff5-a269-f162e5363158 sending to next pipeline
2026-03-30 12:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ea52a23-a59e-5ff5-a269-f162e5363158, identifier: TW15870
2026-03-30 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ea52a23-a59e-5ff5-a269-f162e5363158 with identifier: TW15870
2026-03-30 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ea52a23-a59e-5ff5-a269-f162e5363158 with identifier: TW15870
2026-03-30 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ea52a23-a59e-5ff5-a269-f162e5363158 with identifier: TW15870 to the API
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_42555de7d840aa282a50767ac48c04d7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:21:39Z',
'fuel_type': 'petrol',
'id': '2ea52a23-a59e-5ff5-a269-f162e5363158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15870',
'listing': 'auction',
'location': 'FR, Fouquières-lès-Lens',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 118870,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c57331bbbaa1d809028d292f1403945f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6e8c9c50d40ffdb4e66b9573fe15d95a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2127346,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_13daef328d83627512249bc45cb8f70c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_42555de7d840aa282a50767ac48c04d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_bdc9f63183cdb1c6ac9dbbd9dc672848.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_c34c1b1bbf8a270ae9d1b5aabb2f0b01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_6bd9496703825cc0ddd5c01b2c2a1d4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_affe7134e5d00adc90f84d5476ca46be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153260,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_5972084cf841726756879d830b2f7864.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ea52a23-a59e-5ff5-a269-f162e5363158/2ea52a23-a59e-5ff5-a269-f162e5363158_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2336000,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/1b/bf1be8535bb17e5ab326100b6b48ca52/pa/TW15870_696b50ee12292c77f06249ce7934e7d0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Graphite',
'transmission': 'automatic',
'trim': 'Graphite',
'year': 2018}
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW15870%27 HTTP/1.1" 200 None
2026-03-30 12:02:21 [auto1.fr] INFO: Saving data for TW15870: {'created_time': 1774872141.675267, 'last_price_update_time': 1774872141.675279, 'auction_closing_time': 1774970499.0}
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW15870') HTTP/1.1" 204 0
2026-03-30 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:28 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: ZS16688
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: FY42182
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: GN38354
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: GV41171
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: BL33771
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: RZ77484
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: RG39799
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: AR51988
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: GD65166
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD65166%27 HTTP/1.1" 200 None
2026-03-30 12:02:28 [auto1.fr] INFO: Scrape type for GD65166: 2
2026-03-30 12:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6238b957-e9ea-506c-8183-3c9b44d02005 with identifier: GD65166
2026-03-30 12:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6238b957-e9ea-506c-8183-3c9b44d02005 with scrape type 2
2026-03-30 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6238b957-e9ea-506c-8183-3c9b44d02005 with scrape type 2
2026-03-30 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6238b957-e9ea-506c-8183-3c9b44d02005, identifier: GD65166
2026-03-30 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6238b957-e9ea-506c-8183-3c9b44d02005 with identifier: GD65166
2026-03-30 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6238b957-e9ea-506c-8183-3c9b44d02005 with identifier: GD65166
2026-03-30 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6238b957-e9ea-506c-8183-3c9b44d02005 with identifier: GD65166 to the API
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:23:17Z',
'fuel_type': 'diesel',
'id': '6238b957-e9ea-506c-8183-3c9b44d02005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD65166',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 60102,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-11',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2020}
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD65166%27 HTTP/1.1" 200 None
2026-03-30 12:02:28 [auto1.fr] INFO: Saving data for GD65166: {'auction_closing_time': 1774970597.0, 'created_time': 1773674064.333026, 'last_price_update_time': 1774872148.873078}
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD65166') HTTP/1.1" 204 0
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: VA51344
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: MP21660
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: PF69474
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: DW49496
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: FB81487
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: NY56342
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: LL57961
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: PS75557
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: UE94565
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: HA13685
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: JZ33313
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: CH28631
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: RN18234
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: YT40335
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: LG92938
2026-03-30 12:02:28 [auto1.fr] INFO: Found listing with ID: WA37151
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA37151%27 HTTP/1.1" 200 None
2026-03-30 12:02:28 [auto1.fr] INFO: Scrape type for WA37151: 2
2026-03-30 12:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbabb0e-3546-5a61-b3dd-7781068caed0 with identifier: WA37151
2026-03-30 12:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbabb0e-3546-5a61-b3dd-7781068caed0 with scrape type 2
2026-03-30 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbabb0e-3546-5a61-b3dd-7781068caed0 with scrape type 2
2026-03-30 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fbbabb0e-3546-5a61-b3dd-7781068caed0, identifier: WA37151
2026-03-30 12:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fbbabb0e-3546-5a61-b3dd-7781068caed0 with identifier: WA37151
2026-03-30 12:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fbbabb0e-3546-5a61-b3dd-7781068caed0 with identifier: WA37151
2026-03-30 12:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fbbabb0e-3546-5a61-b3dd-7781068caed0 with identifier: WA37151 to the API
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:53:11Z',
'fuel_type': 'diesel',
'id': 'fbbabb0e-3546-5a61-b3dd-7781068caed0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA37151',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 258818,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-19',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Carminat Tom-Tom',
'transmission': 'manual',
'trim': 'Carminat Tom-Tom',
'year': 2010}
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA37151%27 HTTP/1.1" 200 None
2026-03-30 12:02:29 [auto1.fr] INFO: Saving data for WA37151: {'auction_closing_time': 1774972391.0, 'created_time': 1774278747.351939, 'last_price_update_time': 1774872149.48218}
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WA37151') HTTP/1.1" 204 0
2026-03-30 12:02:29 [auto1.fr] INFO: Found listing with ID: TC10044
2026-03-30 12:02:29 [auto1.fr] INFO: Found listing with ID: JR90965
2026-03-30 12:02:29 [auto1.fr] INFO: Found listing with ID: PS40774
2026-03-30 12:02:29 [auto1.fr] INFO: Found listing with ID: KG78882
2026-03-30 12:02:29 [auto1.fr] INFO: Found listing with ID: BG48993
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG48993%27 HTTP/1.1" 200 None
2026-03-30 12:02:29 [auto1.fr] INFO: Scrape type for BG48993: 2
2026-03-30 12:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with identifier: BG48993
2026-03-30 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with scrape type 2
2026-03-30 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with scrape type 2
2026-03-30 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d4d2b06-772c-5472-9b09-c6dad8ea9236, identifier: BG48993
2026-03-30 12:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with identifier: BG48993
2026-03-30 12:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with identifier: BG48993
2026-03-30 12:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d4d2b06-772c-5472-9b09-c6dad8ea9236 with identifier: BG48993 to the API
2026-03-30 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:45:46Z',
'fuel_type': 'diesel',
'id': '1d4d2b06-772c-5472-9b09-c6dad8ea9236',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG48993',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 188433,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-11',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 2.0 TDI Confortline Business '
'BlueMotion',
'transmission': 'manual',
'trim': 'Confortline Business BlueMotion',
'year': 2014}
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG48993%27 HTTP/1.1" 200 None
2026-03-30 12:02:30 [auto1.fr] INFO: Saving data for BG48993: {'auction_closing_time': 1774971946.0, 'created_time': 1774278938.658626, 'last_price_update_time': 1774872150.264609}
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG48993') HTTP/1.1" 204 0
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: YH25205
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: SN49390
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: JP51471
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP51471%27 HTTP/1.1" 200 None
2026-03-30 12:02:30 [auto1.fr] INFO: Scrape type for JP51471: 2
2026-03-30 12:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fc663e-1d25-506f-8039-06f207f9008e with identifier: JP51471
2026-03-30 12:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fc663e-1d25-506f-8039-06f207f9008e with scrape type 2
2026-03-30 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24fc663e-1d25-506f-8039-06f207f9008e with scrape type 2
2026-03-30 12:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24fc663e-1d25-506f-8039-06f207f9008e, identifier: JP51471
2026-03-30 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24fc663e-1d25-506f-8039-06f207f9008e with identifier: JP51471
2026-03-30 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24fc663e-1d25-506f-8039-06f207f9008e with identifier: JP51471
2026-03-30 12:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24fc663e-1d25-506f-8039-06f207f9008e with identifier: JP51471 to the API
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:06:23Z',
'fuel_type': 'petrol',
'id': '24fc663e-1d25-506f-8039-06f207f9008e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP51471',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 83858,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-27',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2021}
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP51471%27 HTTP/1.1" 200 None
2026-03-30 12:02:30 [auto1.fr] INFO: Saving data for JP51471: {'auction_closing_time': 1774969583.0, 'created_time': 1773691860.724169, 'last_price_update_time': 1774872150.774829}
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP51471') HTTP/1.1" 204 0
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: BU72908
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: AY02939
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: DY99826
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: JZ63677
2026-03-30 12:02:30 [auto1.fr] INFO: Found listing with ID: FL10010
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL10010%27 HTTP/1.1" 200 None
2026-03-30 12:02:30 [auto1.fr] INFO: Scrape type for FL10010: 2
2026-03-30 12:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db772d55-e56f-5e48-85e7-f15b7af6fd6d with identifier: FL10010
2026-03-30 12:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db772d55-e56f-5e48-85e7-f15b7af6fd6d with scrape type 2
2026-03-30 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db772d55-e56f-5e48-85e7-f15b7af6fd6d with scrape type 2
2026-03-30 12:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db772d55-e56f-5e48-85e7-f15b7af6fd6d, identifier: FL10010
2026-03-30 12:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db772d55-e56f-5e48-85e7-f15b7af6fd6d with identifier: FL10010
2026-03-30 12:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db772d55-e56f-5e48-85e7-f15b7af6fd6d with identifier: FL10010
2026-03-30 12:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db772d55-e56f-5e48-85e7-f15b7af6fd6d with identifier: FL10010 to the API
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 240,
'expiration_date': '2026-03-31T15:10:59Z',
'fuel_type': 'diesel',
'id': 'db772d55-e56f-5e48-85e7-f15b7af6fd6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL10010',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 223658,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-17',
'seller_name': None,
'title': 'Audi A5 Sportback 3.0 V6 TDI quattro Ambition Luxe',
'transmission': 'automatic',
'trim': 'quattro Ambition Luxe',
'year': 2010}
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL10010%27 HTTP/1.1" 200 None
2026-03-30 12:02:31 [auto1.fr] INFO: Saving data for FL10010: {'auction_closing_time': 1774969859.0, 'created_time': 1774298065.627945, 'last_price_update_time': 1774872151.503707}
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FL10010') HTTP/1.1" 204 0
2026-03-30 12:02:31 [auto1.fr] INFO: Found listing with ID: YL40024
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL40024%27 HTTP/1.1" 200 None
2026-03-30 12:02:31 [auto1.fr] INFO: Scrape type for YL40024: 2
2026-03-30 12:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with identifier: YL40024
2026-03-30 12:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with scrape type 2
2026-03-30 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with scrape type 2
2026-03-30 12:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d06c4c6-e540-51d2-b251-f5bb64d77bc6, identifier: YL40024
2026-03-30 12:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with identifier: YL40024
2026-03-30 12:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with identifier: YL40024
2026-03-30 12:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d06c4c6-e540-51d2-b251-f5bb64d77bc6 with identifier: YL40024 to the API
2026-03-30 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:28:38Z',
'fuel_type': 'diesel',
'id': '5d06c4c6-e540-51d2-b251-f5bb64d77bc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL40024',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 208208,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-16',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2012}
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL40024%27 HTTP/1.1" 200 None
2026-03-30 12:02:32 [auto1.fr] INFO: Saving data for YL40024: {'auction_closing_time': 1774970918.0, 'created_time': 1774296933.949931, 'last_price_update_time': 1774872152.119285}
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL40024') HTTP/1.1" 204 0
2026-03-30 12:02:32 [auto1.fr] INFO: Found listing with ID: MT51030
2026-03-30 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN46810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU29197> (referer: https://www.auto1.com/v1/car-details-view/PU29197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b8adbf-2ae4-502c-afbb-0c51cf777240 with identifier: PU29197
2026-03-30 12:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b8adbf-2ae4-502c-afbb-0c51cf777240 with scrape type 1
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_226f7858763af04362ff26773b211c06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_226f7858763af04362ff26773b211c06.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_b8f11fedea3a780be2217eafbed07be5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_b8f11fedea3a780be2217eafbed07be5.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_947430b2be3847306849b7f548b28c7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_947430b2be3847306849b7f548b28c7c.jpg not downloaded yet
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_efde722a87b126291270f395ae023c75.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_efde722a87b126291270f395ae023c75.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_803da02d4e8e08424631298cced413e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_803da02d4e8e08424631298cced413e8.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_ced7089e47c589c224aea05542e25af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_ced7089e47c589c224aea05542e25af1.jpg not downloaded yet
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg not downloaded yet
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_226f7858763af04362ff26773b211c06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg not downloaded yet
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d3cd0>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_b8f11fedea3a780be2217eafbed07be5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72882cd290>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_226f7858763af04362ff26773b211c06.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_226f7858763af04362ff26773b211c06.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285154650>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508f750>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_b8f11fedea3a780be2217eafbed07be5.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_b8f11fedea3a780be2217eafbed07be5.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859e5910>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_ced7089e47c589c224aea05542e25af1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_803da02d4e8e08424631298cced413e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_947430b2be3847306849b7f548b28c7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514e1d0>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg saved to cache
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_efde722a87b126291270f395ae023c75.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a2dd0>
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_ced7089e47c589c224aea05542e25af1.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_ced7089e47c589c224aea05542e25af1.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a46d0>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_803da02d4e8e08424631298cced413e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_803da02d4e8e08424631298cced413e8.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a3790>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_947430b2be3847306849b7f548b28c7c.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_947430b2be3847306849b7f548b28c7c.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285abf590>
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6c%252Fad6c69df6d3d33efe3236121b992f8de%252Fpa%252FPU29197_efde722a87b126291270f395ae023c75.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_efde722a87b126291270f395ae023c75.jpg saved to cache
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83b8adbf-2ae4-502c-afbb-0c51cf777240
2026-03-30 12:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83b8adbf-2ae4-502c-afbb-0c51cf777240, skipping ID generation
2026-03-30 12:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b8adbf-2ae4-502c-afbb-0c51cf777240 with scrape type 1
2026-03-30 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83b8adbf-2ae4-502c-afbb-0c51cf777240 sending to next pipeline
2026-03-30 12:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83b8adbf-2ae4-502c-afbb-0c51cf777240, identifier: PU29197
2026-03-30 12:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83b8adbf-2ae4-502c-afbb-0c51cf777240 with identifier: PU29197
2026-03-30 12:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83b8adbf-2ae4-502c-afbb-0c51cf777240 with identifier: PU29197
2026-03-30 12:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83b8adbf-2ae4-502c-afbb-0c51cf777240 with identifier: PU29197 to the API
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_efde722a87b126291270f395ae023c75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 29,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 299,
'expiration_date': '2026-03-31T15:08:14Z',
'fuel_type': 'hybrid',
'id': '83b8adbf-2ae4-502c-afbb-0c51cf777240',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU29197',
'listing': 'auction',
'location': 'FR, La Roche sur Yon',
'make': 'Peugeot',
'model': '3008',
'odometer': 110059,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_e6911b9c42bcaf6e721ebd751b3355b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130993,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_03f5b5cb65ac01164a27f63e398ba5c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_226f7858763af04362ff26773b211c06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_b8f11fedea3a780be2217eafbed07be5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2125300,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_947430b2be3847306849b7f548b28c7c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2075907,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_efde722a87b126291270f395ae023c75.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_803da02d4e8e08424631298cced413e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_ced7089e47c589c224aea05542e25af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_9e9039a9fd05d4a786cdc18dd5bf4c21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b8adbf-2ae4-502c-afbb-0c51cf777240/83b8adbf-2ae4-502c-afbb-0c51cf777240_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/6c/ad6c69df6d3d33efe3236121b992f8de/pa/PU29197_185b6c5cc8a0e8d750d0d3b0170ab940.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid GT Pack',
'transmission': 'automatic',
'trim': 'GT Pack',
'year': 2021}
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU29197%27 HTTP/1.1" 200 None
2026-03-30 12:02:34 [auto1.fr] INFO: Saving data for PU29197: {'created_time': 1774872154.809438, 'last_price_update_time': 1774872154.80945, 'auction_closing_time': 1774969694.0}
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU29197') HTTP/1.1" 204 0
2026-03-30 12:02:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.600(s), this was the 1st time calling it.
2026-03-30 12:02:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.6190677320480855 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.050(s), this was the 1st time calling it.
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.075301536755285 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.072(s), this was the 1st time calling it.
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.712555505020917 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.092(s), this was the 1st time calling it.
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.653922110339988 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.119(s), this was the 1st time calling it.
2026-03-30 12:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.845131732129787 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW53663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK35304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ04008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:54 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 5691 | hits on page: 40
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: MT51030
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: SM29883
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: TL51918
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: DY24427
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: GZ98158
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: ZY65236
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: GN48177
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: LR57312
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: KY87082
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: SM05006
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM05006%27 HTTP/1.1" 200 None
2026-03-30 12:02:54 [auto1.fr] INFO: Scrape type for SM05006: 1
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: FJ63732
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: TG43184
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: BR95734
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: NG62303
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: YW08307
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: YU71333
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU71333%27 HTTP/1.1" 200 None
2026-03-30 12:02:54 [auto1.fr] INFO: Scrape type for YU71333: 2
2026-03-30 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with identifier: YU71333
2026-03-30 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with scrape type 2
2026-03-30 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with scrape type 2
2026-03-30 12:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf5b3a02-0b92-52a1-aafd-0628ee0baa00, identifier: YU71333
2026-03-30 12:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with identifier: YU71333
2026-03-30 12:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with identifier: YU71333
2026-03-30 12:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf5b3a02-0b92-52a1-aafd-0628ee0baa00 with identifier: YU71333 to the API
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-31T15:09:11Z',
'fuel_type': 'petrol',
'id': 'cf5b3a02-0b92-52a1-aafd-0628ee0baa00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU71333',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-21',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 THP Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2015}
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU71333%27 HTTP/1.1" 200 None
2026-03-30 12:02:54 [auto1.fr] INFO: Saving data for YU71333: {'auction_closing_time': 1774969751.0, 'created_time': 1773761351.680567, 'last_price_update_time': 1774872174.781643}
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU71333') HTTP/1.1" 204 0
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 12:02:54 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV11069%27 HTTP/1.1" 200 None
2026-03-30 12:02:54 [auto1.fr] INFO: Scrape type for GV11069: 2
2026-03-30 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24191067-3dac-5dc8-a7dc-478bccd04042 with identifier: GV11069
2026-03-30 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24191067-3dac-5dc8-a7dc-478bccd04042 with scrape type 2
2026-03-30 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24191067-3dac-5dc8-a7dc-478bccd04042 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24191067-3dac-5dc8-a7dc-478bccd04042, identifier: GV11069
2026-03-30 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24191067-3dac-5dc8-a7dc-478bccd04042 with identifier: GV11069
2026-03-30 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24191067-3dac-5dc8-a7dc-478bccd04042 with identifier: GV11069
2026-03-30 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24191067-3dac-5dc8-a7dc-478bccd04042 with identifier: GV11069 to the API
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:18:06Z',
'fuel_type': 'diesel',
'id': '24191067-3dac-5dc8-a7dc-478bccd04042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV11069',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 124336,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-18',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV11069%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Saving data for GV11069: {'auction_closing_time': 1774970286.0, 'created_time': 1774266698.932657, 'last_price_update_time': 1774872175.395346}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV11069') HTTP/1.1" 204 0
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: CE47348
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE47348%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Scrape type for CE47348: 2
2026-03-30 12:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f573e8-6ff7-5508-8030-3d5a0e1be826 with identifier: CE47348
2026-03-30 12:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f573e8-6ff7-5508-8030-3d5a0e1be826 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93f573e8-6ff7-5508-8030-3d5a0e1be826 with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93f573e8-6ff7-5508-8030-3d5a0e1be826, identifier: CE47348
2026-03-30 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93f573e8-6ff7-5508-8030-3d5a0e1be826 with identifier: CE47348
2026-03-30 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93f573e8-6ff7-5508-8030-3d5a0e1be826 with identifier: CE47348
2026-03-30 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93f573e8-6ff7-5508-8030-3d5a0e1be826 with identifier: CE47348 to the API
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:47:23Z',
'fuel_type': 'diesel',
'id': '93f573e8-6ff7-5508-8030-3d5a0e1be826',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE47348',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 221853,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-13',
'seller_name': None,
'title': 'Peugeot 508 1.6 HDi Access',
'transmission': 'automatic',
'trim': 'Access',
'year': 2012}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE47348%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Saving data for CE47348: {'auction_closing_time': 1774972043.0, 'created_time': 1774278741.942843, 'last_price_update_time': 1774872175.855087}
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE47348') HTTP/1.1" 204 0
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: SC47506
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: FA55776
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: RJ76526
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: PX29564
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: BP52149
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: SR29633
2026-03-30 12:02:55 [auto1.fr] INFO: Found listing with ID: ER22482
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER22482%27 HTTP/1.1" 200 None
2026-03-30 12:02:55 [auto1.fr] INFO: Scrape type for ER22482: 2
2026-03-30 12:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06223abc-c4e2-56df-858e-a51b5e9e709d with identifier: ER22482
2026-03-30 12:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06223abc-c4e2-56df-858e-a51b5e9e709d with scrape type 2
2026-03-30 12:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06223abc-c4e2-56df-858e-a51b5e9e709d with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 06223abc-c4e2-56df-858e-a51b5e9e709d, identifier: ER22482
2026-03-30 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 06223abc-c4e2-56df-858e-a51b5e9e709d with identifier: ER22482
2026-03-30 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 06223abc-c4e2-56df-858e-a51b5e9e709d with identifier: ER22482
2026-03-30 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 06223abc-c4e2-56df-858e-a51b5e9e709d with identifier: ER22482 to the API
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:32:21Z',
'fuel_type': 'diesel',
'id': '06223abc-c4e2-56df-858e-a51b5e9e709d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER22482',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 69107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-26',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L1H1 1000kg Confort',
'transmission': 'manual',
'trim': 'L1H1 1000kg Confort',
'year': 2020}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER22482%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Saving data for ER22482: {'auction_closing_time': 1774971141.0, 'created_time': 1774278716.444873, 'last_price_update_time': 1774872176.340477}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER22482') HTTP/1.1" 204 0
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: TW16745
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW16745%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Scrape type for TW16745: 2
2026-03-30 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285fecaa-54a8-580c-9771-992f873ecd97 with identifier: TW16745
2026-03-30 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285fecaa-54a8-580c-9771-992f873ecd97 with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285fecaa-54a8-580c-9771-992f873ecd97 with scrape type 2
2026-03-30 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 285fecaa-54a8-580c-9771-992f873ecd97, identifier: TW16745
2026-03-30 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 285fecaa-54a8-580c-9771-992f873ecd97 with identifier: TW16745
2026-03-30 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 285fecaa-54a8-580c-9771-992f873ecd97 with identifier: TW16745
2026-03-30 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 285fecaa-54a8-580c-9771-992f873ecd97 with identifier: TW16745 to the API
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:30:27Z',
'fuel_type': 'diesel',
'id': '285fecaa-54a8-580c-9771-992f873ecd97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW16745',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 158429,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-08',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Campus Authentique',
'transmission': 'manual',
'trim': 'Campus Authentique',
'year': 2009}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW16745%27 HTTP/1.1" 200 None
2026-03-30 12:02:56 [auto1.fr] INFO: Saving data for TW16745: {'auction_closing_time': 1774971027.0, 'created_time': 1772817917.632459, 'last_price_update_time': 1774872176.966119}
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW16745') HTTP/1.1" 204 0
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: VN64150
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: FK36448
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: FS93369
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: UB37186
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: TR84613
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: VX34217
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: UC60343
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: DF41129
2026-03-30 12:02:56 [auto1.fr] INFO: Found listing with ID: CD49178
2026-03-30 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD49178%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Scrape type for CD49178: 2
2026-03-30 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9e477b-6223-59a3-a19b-7b9874591a7a with identifier: CD49178
2026-03-30 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9e477b-6223-59a3-a19b-7b9874591a7a with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9e477b-6223-59a3-a19b-7b9874591a7a with scrape type 2
2026-03-30 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f9e477b-6223-59a3-a19b-7b9874591a7a, identifier: CD49178
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN46810> (referer: https://www.auto1.com/v1/car-details-view/ZN46810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f9e477b-6223-59a3-a19b-7b9874591a7a with identifier: CD49178
2026-03-30 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f9e477b-6223-59a3-a19b-7b9874591a7a with identifier: CD49178
2026-03-30 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f9e477b-6223-59a3-a19b-7b9874591a7a with identifier: CD49178 to the API
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:39Z',
'fuel_type': 'petrol',
'id': '9f9e477b-6223-59a3-a19b-7b9874591a7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD49178',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 188803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD49178%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [auto1.fr] INFO: Saving data for CD49178: {'auction_closing_time': 1774971879.0, 'created_time': 1773330930.785898, 'last_price_update_time': 1774872177.489067}
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD49178') HTTP/1.1" 204 0
2026-03-30 12:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: AK18752
2026-03-30 12:02:57 [auto1.fr] INFO: Found listing with ID: CC48181
2026-03-30 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a4be91-021d-5ddd-a483-484a8e9848d7 with identifier: ZN46810
2026-03-30 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a4be91-021d-5ddd-a483-484a8e9848d7 with scrape type 1
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_f2aa1ede947896f90323b09001a3a324.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_f2aa1ede947896f90323b09001a3a324.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_242feacc7ecc020be40f77ce999e4283.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_242feacc7ecc020be40f77ce999e4283.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_3773afaad130df7128df5e16e2971b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_3773afaad130df7128df5e16e2971b21.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_60c91fa6b513808e84da806913a69280.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_60c91fa6b513808e84da806913a69280.jpg not downloaded yet
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg not downloaded yet
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg not downloaded yet
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg not downloaded yet
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_f2aa1ede947896f90323b09001a3a324.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285078f50>
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg saved to cache
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512fc50>
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg saved to cache
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f729566b350>
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_f2aa1ede947896f90323b09001a3a324.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_f2aa1ede947896f90323b09001a3a324.jpg saved to cache
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512fb50>
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg saved to cache
2026-03-30 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_242feacc7ecc020be40f77ce999e4283.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_3773afaad130df7128df5e16e2971b21.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_60c91fa6b513808e84da806913a69280.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728510a290>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a07190>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508e090>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850aa650>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_242feacc7ecc020be40f77ce999e4283.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_242feacc7ecc020be40f77ce999e4283.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac5850>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_3773afaad130df7128df5e16e2971b21.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_3773afaad130df7128df5e16e2971b21.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a28110>
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Faa%252F90aaa97406592fdb5417863127f46c25%252Fpa%252FZN46810_60c91fa6b513808e84da806913a69280.jpg') HTTP/1.1" 204 0
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_60c91fa6b513808e84da806913a69280.jpg saved to cache
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7a4be91-021d-5ddd-a483-484a8e9848d7
2026-03-30 12:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7a4be91-021d-5ddd-a483-484a8e9848d7, skipping ID generation
2026-03-30 12:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a4be91-021d-5ddd-a483-484a8e9848d7 with scrape type 1
2026-03-30 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7a4be91-021d-5ddd-a483-484a8e9848d7 sending to next pipeline
2026-03-30 12:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7a4be91-021d-5ddd-a483-484a8e9848d7, identifier: ZN46810
2026-03-30 12:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7a4be91-021d-5ddd-a483-484a8e9848d7 with identifier: ZN46810
2026-03-30 12:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7a4be91-021d-5ddd-a483-484a8e9848d7 with identifier: ZN46810
2026-03-30 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7a4be91-021d-5ddd-a483-484a8e9848d7 with identifier: ZN46810 to the API
2026-03-30 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_60c91fa6b513808e84da806913a69280.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:47:02Z',
'fuel_type': 'diesel',
'id': 'a7a4be91-021d-5ddd-a483-484a8e9848d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN46810',
'listing': 'auction',
'location': 'FR',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 175332,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_aa518a174fd1f80fb98ff8898089edf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_44ef9b109003d1949ad948dbaf345ed7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_a4a1c6465eacdee152c010946ed2afdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_f2aa1ede947896f90323b09001a3a324.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_242feacc7ecc020be40f77ce999e4283.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_3773afaad130df7128df5e16e2971b21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_60c91fa6b513808e84da806913a69280.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_e47919c2f9abe2c45fca5fc1481c6070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_98cff9ffb5a374cda1825d54e4364b2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a4be91-021d-5ddd-a483-484a8e9848d7/a7a4be91-021d-5ddd-a483-484a8e9848d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/aa/90aaa97406592fdb5417863127f46c25/pa/ZN46810_8f4e36afdb5a9da327a376cfa3a659f9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-04-21',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 CDTI Cosmo Pack',
'transmission': 'manual',
'trim': 'Cosmo Pack',
'year': 2015}
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN46810%27 HTTP/1.1" 200 None
2026-03-30 12:02:59 [auto1.fr] INFO: Saving data for ZN46810: {'created_time': 1774872179.266745, 'last_price_update_time': 1774872179.266758, 'auction_closing_time': 1774972022.0}
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN46810') HTTP/1.1" 204 0
2026-03-30 12:02:59 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 15 pages/min), scraped 89 items (at 23 items/min)
2026-03-30 12:02:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK63519/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK35304> (referer: https://www.auto1.com/v1/car-details-view/JK35304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa72ff5-8c99-5be2-8945-55fcd38d52b1 with identifier: JK35304
2026-03-30 12:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa72ff5-8c99-5be2-8945-55fcd38d52b1 with scrape type 1
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fa72ff5-8c99-5be2-8945-55fcd38d52b1
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_175a834af6f06fbc3363f336c9cbd94d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_175a834af6f06fbc3363f336c9cbd94d.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_bcbe7a87087e2028c30cc0af41041b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_bcbe7a87087e2028c30cc0af41041b70.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_0a64401a9d37e0ba838d593fcd0f38f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0a64401a9d37e0ba838d593fcd0f38f5.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_e65f92ff6ba26d96fbbe60cf64c61536.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_e65f92ff6ba26d96fbbe60cf64c61536.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_06344c0e12180c1a89d825c6b5e2e355.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_06344c0e12180c1a89d825c6b5e2e355.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_0f37c587c76b8fd42d769f61bd852441.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0f37c587c76b8fd42d769f61bd852441.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_12d667d4a851b4fd0edb8d22f05b7b24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_12d667d4a851b4fd0edb8d22f05b7b24.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_6c8f3c32d6709a507729cab07ea54ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_6c8f3c32d6709a507729cab07ea54ce0.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_db196a5d840ec14d8d98923308859eb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_db196a5d840ec14d8d98923308859eb9.jpg already downloaded
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F02%252Fc402a00773d10e3054d68d44938ad6cb%252Fpa%252FJK35304_54eabab25b961c040e6b4ffa92e941a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_54eabab25b961c040e6b4ffa92e941a0.jpg already downloaded
2026-03-30 12:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5fa72ff5-8c99-5be2-8945-55fcd38d52b1, identifier: JK35304
2026-03-30 12:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5fa72ff5-8c99-5be2-8945-55fcd38d52b1 with identifier: JK35304
2026-03-30 12:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5fa72ff5-8c99-5be2-8945-55fcd38d52b1 with identifier: JK35304
2026-03-30 12:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5fa72ff5-8c99-5be2-8945-55fcd38d52b1 with identifier: JK35304 to the API
2026-03-30 12:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK35304>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:10:26Z',
'fuel_type': 'diesel',
'id': '5fa72ff5-8c99-5be2-8945-55fcd38d52b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK35304',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 151533,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_175a834af6f06fbc3363f336c9cbd94d.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_bcbe7a87087e2028c30cc0af41041b70.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0a64401a9d37e0ba838d593fcd0f38f5.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_e65f92ff6ba26d96fbbe60cf64c61536.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_06344c0e12180c1a89d825c6b5e2e355.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0f37c587c76b8fd42d769f61bd852441.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_12d667d4a851b4fd0edb8d22f05b7b24.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_6c8f3c32d6709a507729cab07ea54ce0.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_db196a5d840ec14d8d98923308859eb9.jpg',
'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_54eabab25b961c040e6b4ffa92e941a0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_175a834af6f06fbc3363f336c9cbd94d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_bcbe7a87087e2028c30cc0af41041b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0a64401a9d37e0ba838d593fcd0f38f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_e65f92ff6ba26d96fbbe60cf64c61536.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3104118,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_06344c0e12180c1a89d825c6b5e2e355.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_0f37c587c76b8fd42d769f61bd852441.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_12d667d4a851b4fd0edb8d22f05b7b24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2489655,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_6c8f3c32d6709a507729cab07ea54ce0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2929683,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_db196a5d840ec14d8d98923308859eb9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa72ff5-8c99-5be2-8945-55fcd38d52b1/5fa72ff5-8c99-5be2-8945-55fcd38d52b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2823588,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/02/c402a00773d10e3054d68d44938ad6cb/pa/JK35304_54eabab25b961c040e6b4ffa92e941a0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI Carat',
'transmission': 'manual',
'trim': 'Carat',
'year': 2021}
2026-03-30 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK35304%27 HTTP/1.1" 200 None
2026-03-30 12:03:06 [auto1.fr] INFO: Saving data for JK35304: {'created_time': 1774872186.162172, 'last_price_update_time': 1774872186.162183, 'auction_closing_time': 1774969826.0}
2026-03-30 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK35304') HTTP/1.1" 204 0
2026-03-30 12:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD74717/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU85731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:08 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 5694 | hits on page: 40
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: CD49178
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD49178%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [auto1.fr] INFO: Scrape type for CD49178: 0
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: AK18752
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: CC48181
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: RG71541
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: PW84769
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW84769%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [auto1.fr] INFO: Scrape type for PW84769: 2
2026-03-30 12:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with identifier: PW84769
2026-03-30 12:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with scrape type 2
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with scrape type 2
2026-03-30 12:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf56bd52-491b-5ce1-a1dd-a4b9d6c04038, identifier: PW84769
2026-03-30 12:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with identifier: PW84769
2026-03-30 12:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with identifier: PW84769
2026-03-30 12:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf56bd52-491b-5ce1-a1dd-a4b9d6c04038 with identifier: PW84769 to the API
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:49:44Z',
'fuel_type': 'diesel',
'id': 'bf56bd52-491b-5ce1-a1dd-a4b9d6c04038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW84769',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 177785,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-20',
'seller_name': None,
'title': 'Peugeot Boxer 2.2 HDi 330 L1H1 Komfort Plus HDi 110',
'transmission': 'manual',
'trim': '330 L1H1 Komfort Plus HDi 110',
'year': 2015}
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW84769%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [auto1.fr] INFO: Saving data for PW84769: {'auction_closing_time': 1774972184.0, 'created_time': 1771408961.792876, 'last_price_update_time': 1774872188.809129}
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW84769') HTTP/1.1" 204 0
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: UU20581
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: NS62449
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: SU26545
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: ZH11864
2026-03-30 12:03:08 [auto1.fr] INFO: Found listing with ID: WW50830
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW50830%27 HTTP/1.1" 200 None
2026-03-30 12:03:08 [auto1.fr] INFO: Scrape type for WW50830: 2
2026-03-30 12:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with identifier: WW50830
2026-03-30 12:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with scrape type 2
2026-03-30 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with scrape type 2
2026-03-30 12:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f, identifier: WW50830
2026-03-30 12:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with identifier: WW50830
2026-03-30 12:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with identifier: WW50830
2026-03-30 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f with identifier: WW50830 to the API
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:41:39Z',
'fuel_type': 'petrol',
'id': '87dd8c1c-8906-54d9-ab6d-c38ff53a7c4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW50830',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 178174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-02',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW50830%27 HTTP/1.1" 200 None
2026-03-30 12:03:09 [auto1.fr] INFO: Saving data for WW50830: {'auction_closing_time': 1774971699.0, 'created_time': 1773693655.941143, 'last_price_update_time': 1774872189.382939}
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW50830') HTTP/1.1" 204 0
2026-03-30 12:03:09 [auto1.fr] INFO: Found listing with ID: UW11385
2026-03-30 12:03:09 [auto1.fr] INFO: Found listing with ID: EY85679
2026-03-30 12:03:09 [auto1.fr] INFO: Found listing with ID: GE12087
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE12087%27 HTTP/1.1" 200 None
2026-03-30 12:03:09 [auto1.fr] INFO: Scrape type for GE12087: 2
2026-03-30 12:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e00362d-6293-54b6-8b08-58a6371fd6dc with identifier: GE12087
2026-03-30 12:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e00362d-6293-54b6-8b08-58a6371fd6dc with scrape type 2
2026-03-30 12:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e00362d-6293-54b6-8b08-58a6371fd6dc with scrape type 2
2026-03-30 12:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e00362d-6293-54b6-8b08-58a6371fd6dc, identifier: GE12087
2026-03-30 12:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e00362d-6293-54b6-8b08-58a6371fd6dc with identifier: GE12087
2026-03-30 12:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e00362d-6293-54b6-8b08-58a6371fd6dc with identifier: GE12087
2026-03-30 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e00362d-6293-54b6-8b08-58a6371fd6dc with identifier: GE12087 to the API
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:42:56Z',
'fuel_type': 'petrol',
'id': '8e00362d-6293-54b6-8b08-58a6371fd6dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE12087',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 92165,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-24',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2020}
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE12087%27 HTTP/1.1" 200 None
2026-03-30 12:03:09 [auto1.fr] INFO: Saving data for GE12087: {'auction_closing_time': 1774971776.0, 'created_time': 1774452083.974584, 'last_price_update_time': 1774872189.894579}
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE12087') HTTP/1.1" 204 0
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: HR25538
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: PB55961
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB67890%27 HTTP/1.1" 200 None
2026-03-30 12:03:10 [auto1.fr] INFO: Scrape type for HB67890: 1
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: ER94333
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: WU73634
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: TZ86489
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: PV12001
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: VD06652
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: UV64510
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: SN68527
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: XE23390
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: UL33581
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL33581%27 HTTP/1.1" 200 None
2026-03-30 12:03:10 [auto1.fr] INFO: Scrape type for UL33581: 1
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: KT63849
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: GC83047
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC83047%27 HTTP/1.1" 200 None
2026-03-30 12:03:10 [auto1.fr] INFO: Scrape type for GC83047: 2
2026-03-30 12:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601cdd16-ce3e-528c-a232-886a36c3003a with identifier: GC83047
2026-03-30 12:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601cdd16-ce3e-528c-a232-886a36c3003a with scrape type 2
2026-03-30 12:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601cdd16-ce3e-528c-a232-886a36c3003a with scrape type 2
2026-03-30 12:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 601cdd16-ce3e-528c-a232-886a36c3003a, identifier: GC83047
2026-03-30 12:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 601cdd16-ce3e-528c-a232-886a36c3003a with identifier: GC83047
2026-03-30 12:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 601cdd16-ce3e-528c-a232-886a36c3003a with identifier: GC83047
2026-03-30 12:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 601cdd16-ce3e-528c-a232-886a36c3003a with identifier: GC83047 to the API
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:35:57Z',
'fuel_type': 'diesel',
'id': '601cdd16-ce3e-528c-a232-886a36c3003a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC83047',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 112551,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-30',
'seller_name': None,
'title': 'BMW X5 xDrive 30d Luxe',
'transmission': 'automatic',
'trim': 'Luxe',
'year': 2011}
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC83047%27 HTTP/1.1" 200 None
2026-03-30 12:03:10 [auto1.fr] INFO: Saving data for GC83047: {'auction_closing_time': 1774971357.0, 'created_time': 1774267364.448334, 'last_price_update_time': 1774872190.523197}
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC83047') HTTP/1.1" 204 0
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: LY86888
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: RD85936
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: VT02723
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: GV35927
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: DE97231
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: HC40418
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: KX63336
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: AV52301
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: MK51863
2026-03-30 12:03:10 [auto1.fr] INFO: Found listing with ID: PJ68004
2026-03-30 12:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ04008> (referer: https://www.auto1.com/v1/car-details-view/LJ04008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ec117e-7168-5ee3-959b-fb036cc4555f with identifier: LJ04008
2026-03-30 12:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ec117e-7168-5ee3-959b-fb036cc4555f with scrape type 1
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8ec117e-7168-5ee3-959b-fb036cc4555f
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_15ea759c93d4340723892fb5300cedf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_15ea759c93d4340723892fb5300cedf8.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_530696553f3e1719a8d25cc7d4f1461b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_530696553f3e1719a8d25cc7d4f1461b.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_1a5797f2ce7f5f0bf5887b5168444e53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_1a5797f2ce7f5f0bf5887b5168444e53.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_c1d72cae85bdd69b83f9fadf6bb73000.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c1d72cae85bdd69b83f9fadf6bb73000.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_6e7958844d1507028c519550a9dabe22.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_6e7958844d1507028c519550a9dabe22.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_80ead14e51be28b3017a67f725b8ba8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_80ead14e51be28b3017a67f725b8ba8b.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_4a301a056b93a3bb545955dc184192cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_4a301a056b93a3bb545955dc184192cb.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_b6d8c8d4bf9e804b4cecbef4d36dadc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_b6d8c8d4bf9e804b4cecbef4d36dadc0.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_3fa27a9249c1cd07b4fa9dbc3b3b1cdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_3fa27a9249c1cd07b4fa9dbc3b3b1cdc.jpg already downloaded
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fa6%252F93a6b9a3759fc7b6835f4739333c412e%252Fpa%252FLJ04008_c6f9b69ea115ebf881d0ca3b4fd5317b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c6f9b69ea115ebf881d0ca3b4fd5317b.jpg already downloaded
2026-03-30 12:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8ec117e-7168-5ee3-959b-fb036cc4555f, identifier: LJ04008
2026-03-30 12:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8ec117e-7168-5ee3-959b-fb036cc4555f with identifier: LJ04008
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 12:03:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8ec117e-7168-5ee3-959b-fb036cc4555f with identifier: LJ04008
2026-03-30 12:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8ec117e-7168-5ee3-959b-fb036cc4555f with identifier: LJ04008 to the API
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ04008>
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:43:52Z',
'fuel_type': 'diesel',
'id': 'f8ec117e-7168-5ee3-959b-fb036cc4555f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ04008',
'listing': 'auction',
'location': 'Chartres',
'make': 'Peugeot',
'model': '208',
'odometer': 207103,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_15ea759c93d4340723892fb5300cedf8.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_530696553f3e1719a8d25cc7d4f1461b.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_1a5797f2ce7f5f0bf5887b5168444e53.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c1d72cae85bdd69b83f9fadf6bb73000.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_6e7958844d1507028c519550a9dabe22.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_80ead14e51be28b3017a67f725b8ba8b.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_4a301a056b93a3bb545955dc184192cb.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_b6d8c8d4bf9e804b4cecbef4d36dadc0.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_3fa27a9249c1cd07b4fa9dbc3b3b1cdc.jpg',
'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c6f9b69ea115ebf881d0ca3b4fd5317b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_15ea759c93d4340723892fb5300cedf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_530696553f3e1719a8d25cc7d4f1461b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_1a5797f2ce7f5f0bf5887b5168444e53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c1d72cae85bdd69b83f9fadf6bb73000.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_6e7958844d1507028c519550a9dabe22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_80ead14e51be28b3017a67f725b8ba8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3053468,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_4a301a056b93a3bb545955dc184192cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_b6d8c8d4bf9e804b4cecbef4d36dadc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2649260,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_3fa27a9249c1cd07b4fa9dbc3b3b1cdc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8ec117e-7168-5ee3-959b-fb036cc4555f/f8ec117e-7168-5ee3-959b-fb036cc4555f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818846,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img93/a6/93a6b9a3759fc7b6835f4739333c412e/pa/LJ04008_c6f9b69ea115ebf881d0ca3b4fd5317b.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi Active Auto Ecole',
'transmission': 'manual',
'trim': 'Active Auto Ecole',
'year': 2015}
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ04008%27 HTTP/1.1" 200 None
2026-03-30 12:03:15 [auto1.fr] INFO: Saving data for LJ04008: {'created_time': 1774872195.944068, 'last_price_update_time': 1774872195.94408, 'auction_closing_time': 1774971832.0}
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ04008') HTTP/1.1" 204 0
2026-03-30 12:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD74717> (referer: https://www.auto1.com/v1/car-details-view/MD74717/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f215b424-9aa1-5fdf-aab1-1d255fbeabc9 with identifier: MD74717
2026-03-30 12:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f215b424-9aa1-5fdf-aab1-1d255fbeabc9 with scrape type 1
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f215b424-9aa1-5fdf-aab1-1d255fbeabc9
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_0e481b3dd27542bb5fc39c68aa7d00b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_0e481b3dd27542bb5fc39c68aa7d00b7.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_7ab1376a91e8cd30688437494716b96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_7ab1376a91e8cd30688437494716b96f.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_33f4a6f0305357e3c7e64c973c4c8faa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_33f4a6f0305357e3c7e64c973c4c8faa.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_bacc82f8137baf1475c8043f47429ed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_bacc82f8137baf1475c8043f47429ed6.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_b229c59727d1291d622330a2375cd202.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_b229c59727d1291d622330a2375cd202.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_d5f94780bc23da5b779f4a9b5a25d4e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d5f94780bc23da5b779f4a9b5a25d4e4.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_5a58f5af79a223a8441fb690567e422e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_5a58f5af79a223a8441fb690567e422e.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_d7a89e4eedfa85cf50cf52b69be8cc75.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d7a89e4eedfa85cf50cf52b69be8cc75.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_4032a5496e7efe0b63820cc3cd58062b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_4032a5496e7efe0b63820cc3cd58062b.jpg already downloaded
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Ff0%252F0ff06bf100613bcf2177305d4fff3f96%252Fpa%252FMD74717_529012f10db9df94e605c23a22fe8ab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_529012f10db9df94e605c23a22fe8ab6.jpg already downloaded
2026-03-30 12:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f215b424-9aa1-5fdf-aab1-1d255fbeabc9, identifier: MD74717
2026-03-30 12:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f215b424-9aa1-5fdf-aab1-1d255fbeabc9 with identifier: MD74717
2026-03-30 12:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f215b424-9aa1-5fdf-aab1-1d255fbeabc9 with identifier: MD74717
2026-03-30 12:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f215b424-9aa1-5fdf-aab1-1d255fbeabc9 with identifier: MD74717 to the API
2026-03-30 12:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD74717>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:31:33Z',
'fuel_type': 'diesel',
'id': 'f215b424-9aa1-5fdf-aab1-1d255fbeabc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD74717',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 117239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_0e481b3dd27542bb5fc39c68aa7d00b7.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_7ab1376a91e8cd30688437494716b96f.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_33f4a6f0305357e3c7e64c973c4c8faa.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_bacc82f8137baf1475c8043f47429ed6.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_b229c59727d1291d622330a2375cd202.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d5f94780bc23da5b779f4a9b5a25d4e4.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_5a58f5af79a223a8441fb690567e422e.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d7a89e4eedfa85cf50cf52b69be8cc75.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_4032a5496e7efe0b63820cc3cd58062b.jpg',
'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_529012f10db9df94e605c23a22fe8ab6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_0e481b3dd27542bb5fc39c68aa7d00b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_7ab1376a91e8cd30688437494716b96f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_33f4a6f0305357e3c7e64c973c4c8faa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_bacc82f8137baf1475c8043f47429ed6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_b229c59727d1291d622330a2375cd202.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d5f94780bc23da5b779f4a9b5a25d4e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_5a58f5af79a223a8441fb690567e422e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_d7a89e4eedfa85cf50cf52b69be8cc75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_4032a5496e7efe0b63820cc3cd58062b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f215b424-9aa1-5fdf-aab1-1d255fbeabc9/f215b424-9aa1-5fdf-aab1-1d255fbeabc9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/f0/0ff06bf100613bcf2177305d4fff3f96/pa/MD74717_529012f10db9df94e605c23a22fe8ab6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-26',
'seats_number': 7,
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-30 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD74717%27 HTTP/1.1" 200 None
2026-03-30 12:03:24 [auto1.fr] INFO: Saving data for MD74717: {'created_time': 1774872204.203196, 'last_price_update_time': 1774872204.203208, 'auction_closing_time': 1774971093.0}
2026-03-30 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MD74717') HTTP/1.1" 204 0
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK63519> (referer: https://www.auto1.com/v1/car-details-view/KK63519/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734d5ba2-4bbc-5632-a60b-5f286b289db9 with identifier: KK63519
2026-03-30 12:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734d5ba2-4bbc-5632-a60b-5f286b289db9 with scrape type 1
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_8108f810ffdca8291382bda8f5b8460e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_8108f810ffdca8291382bda8f5b8460e.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg not downloaded yet
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_ffc59de2662684cc93e611ea0b31d89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_ffc59de2662684cc93e611ea0b31d89d.jpg not downloaded yet
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg not downloaded yet
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg not downloaded yet
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b44d0>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_8108f810ffdca8291382bda8f5b8460e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b6990>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850e9910>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b30b50>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_8108f810ffdca8291382bda8f5b8460e.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_8108f810ffdca8291382bda8f5b8460e.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285079510>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512e090>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aaef90>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ea9d0>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_ffc59de2662684cc93e611ea0b31d89d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf8750>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_ffc59de2662684cc93e611ea0b31d89d.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_ffc59de2662684cc93e611ea0b31d89d.jpg saved to cache
2026-03-30 12:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514e710>
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F0e%252F7d0e3c2aca642648cbdd6d4a40bb9742%252Fpa%252FKK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg saved to cache
2026-03-30 12:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 734d5ba2-4bbc-5632-a60b-5f286b289db9
2026-03-30 12:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 734d5ba2-4bbc-5632-a60b-5f286b289db9, skipping ID generation
2026-03-30 12:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734d5ba2-4bbc-5632-a60b-5f286b289db9 with scrape type 1
2026-03-30 12:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 734d5ba2-4bbc-5632-a60b-5f286b289db9 sending to next pipeline
2026-03-30 12:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 734d5ba2-4bbc-5632-a60b-5f286b289db9, identifier: KK63519
2026-03-30 12:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 734d5ba2-4bbc-5632-a60b-5f286b289db9 with identifier: KK63519
2026-03-30 12:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 734d5ba2-4bbc-5632-a60b-5f286b289db9 with identifier: KK63519
2026-03-30 12:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 734d5ba2-4bbc-5632-a60b-5f286b289db9 with identifier: KK63519 to the API
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:51:59Z',
'fuel_type': 'diesel',
'id': '734d5ba2-4bbc-5632-a60b-5f286b289db9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK63519',
'listing': 'auction',
'location': 'FR, Antibes',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 102101,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_829a14447911dfcc9b84ceee78c3cdc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_8108f810ffdca8291382bda8f5b8460e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_76b879a01b5c4c3c6e93dd1f2866d765.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_fe0f6dc0fa8dc33edd8183fcd210f955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_3fddf07d1da3c0588d6a4d48c16783b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_e39170c1959e0976fe4efe1c04fae2c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2319727,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_a9f2ef6a9288664169b31b09dceb7ab8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_ffc59de2662684cc93e611ea0b31d89d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_b8923e85d36e60d1bf59adebd1a75b4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734d5ba2-4bbc-5632-a60b-5f286b289db9/734d5ba2-4bbc-5632-a60b-5f286b289db9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/0e/7d0e3c2aca642648cbdd6d4a40bb9742/pa/KK63519_55edc27a0dc31c9ec9eb2e73f7c9f6e7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2017}
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK63519%27 HTTP/1.1" 200 None
2026-03-30 12:03:30 [auto1.fr] INFO: Saving data for KK63519: {'created_time': 1774872210.527292, 'last_price_update_time': 1774872210.527304, 'auction_closing_time': 1774972319.0}
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KK63519') HTTP/1.1" 204 0
2026-03-30 12:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU85731> (referer: https://www.auto1.com/v1/car-details-view/KU85731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a31240ea-84ae-5b3d-bb53-19c49f44b802 with identifier: KU85731
2026-03-30 12:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31240ea-84ae-5b3d-bb53-19c49f44b802 with scrape type 1
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_d43035ea362588369d4afa328b07941a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_d43035ea362588369d4afa328b07941a.jpg not downloaded yet
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg not downloaded yet
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_467606727e566c4299114109d9c60d22.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_467606727e566c4299114109d9c60d22.jpg not downloaded yet
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_47dba34ce4903f521b2349be40676302.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_47dba34ce4903f521b2349be40676302.jpg not downloaded yet
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg not downloaded yet
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg not downloaded yet
2026-03-30 12:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_d43035ea362588369d4afa328b07941a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_467606727e566c4299114109d9c60d22.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_47dba34ce4903f521b2349be40676302.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879fe4d0>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_d43035ea362588369d4afa328b07941a.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_d43035ea362588369d4afa328b07941a.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c24d10>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d9750>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_467606727e566c4299114109d9c60d22.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_467606727e566c4299114109d9c60d22.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285141b10>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_47dba34ce4903f521b2349be40676302.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_47dba34ce4903f521b2349be40676302.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a55ed0>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285147a50>
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Faa%252Fc1aa109dc100fba70e2042eb904ea7fe%252Fpa%252FKU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg') HTTP/1.1" 204 0
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg saved to cache
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a31240ea-84ae-5b3d-bb53-19c49f44b802
2026-03-30 12:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a31240ea-84ae-5b3d-bb53-19c49f44b802, skipping ID generation
2026-03-30 12:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31240ea-84ae-5b3d-bb53-19c49f44b802 with scrape type 1
2026-03-30 12:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a31240ea-84ae-5b3d-bb53-19c49f44b802 sending to next pipeline
2026-03-30 12:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a31240ea-84ae-5b3d-bb53-19c49f44b802, identifier: KU85731
2026-03-30 12:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a31240ea-84ae-5b3d-bb53-19c49f44b802 with identifier: KU85731
2026-03-30 12:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a31240ea-84ae-5b3d-bb53-19c49f44b802 with identifier: KU85731
2026-03-30 12:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a31240ea-84ae-5b3d-bb53-19c49f44b802 with identifier: KU85731 to the API
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:08:16Z',
'fuel_type': 'petrol',
'id': 'a31240ea-84ae-5b3d-bb53-19c49f44b802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU85731',
'listing': 'auction',
'location': 'FR, Saint-Etienne',
'make': 'Peugeot',
'model': '208',
'odometer': 204146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_d43035ea362588369d4afa328b07941a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_5fdbce95e49f8ae2e21732d5da5c3e3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_467606727e566c4299114109d9c60d22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_47dba34ce4903f521b2349be40676302.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_2ea08ffef9aa77ce296464a3042b9a53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31240ea-84ae-5b3d-bb53-19c49f44b802/a31240ea-84ae-5b3d-bb53-19c49f44b802_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/aa/c1aa109dc100fba70e2042eb904ea7fe/pa/KU85731_aa7f7cb5abbf5e7af072a2a80107240d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU85731%27 HTTP/1.1" 200 None
2026-03-30 12:03:32 [auto1.fr] INFO: Saving data for KU85731: {'created_time': 1774872212.8361, 'last_price_update_time': 1774872212.836113, 'auction_closing_time': 1774969696.0}
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KU85731') HTTP/1.1" 204 0
2026-03-30 12:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB67890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.931(s), this was the 1st time calling it.
2026-03-30 12:03:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.117402517883409 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:33 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 5695 | hits on page: 40
2026-03-30 12:03:33 [auto1.fr] INFO: Found listing with ID: PJ68004
2026-03-30 12:03:33 [auto1.fr] INFO: Found listing with ID: AG05913
2026-03-30 12:03:33 [auto1.fr] INFO: Found listing with ID: AE64159
2026-03-30 12:03:33 [auto1.fr] INFO: Found listing with ID: RZ51319
2026-03-30 12:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ51319%27 HTTP/1.1" 200 None
2026-03-30 12:03:33 [auto1.fr] INFO: Scrape type for RZ51319: 2
2026-03-30 12:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6833f0d-a22b-5d74-a9b3-96ce887560d3 with identifier: RZ51319
2026-03-30 12:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6833f0d-a22b-5d74-a9b3-96ce887560d3 with scrape type 2
2026-03-30 12:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6833f0d-a22b-5d74-a9b3-96ce887560d3 with scrape type 2
2026-03-30 12:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f6833f0d-a22b-5d74-a9b3-96ce887560d3, identifier: RZ51319
2026-03-30 12:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f6833f0d-a22b-5d74-a9b3-96ce887560d3 with identifier: RZ51319
2026-03-30 12:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f6833f0d-a22b-5d74-a9b3-96ce887560d3 with identifier: RZ51319
2026-03-30 12:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f6833f0d-a22b-5d74-a9b3-96ce887560d3 with identifier: RZ51319 to the API
2026-03-30 12:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:32:46Z',
'fuel_type': 'petrol',
'id': 'f6833f0d-a22b-5d74-a9b3-96ce887560d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ51319',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 78370,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-11',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2021}
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ51319%27 HTTP/1.1" 200 None
2026-03-30 12:03:34 [auto1.fr] INFO: Saving data for RZ51319: {'auction_closing_time': 1774971166.0, 'created_time': 1772777512.491754, 'last_price_update_time': 1774872214.095035}
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ51319') HTTP/1.1" 204 0
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: GG06949
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: DD12219
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: DS07902
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: GK41383
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK41383%27 HTTP/1.1" 200 None
2026-03-30 12:03:34 [auto1.fr] INFO: Scrape type for GK41383: 1
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: WR47867
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR47867%27 HTTP/1.1" 200 None
2026-03-30 12:03:34 [auto1.fr] INFO: Scrape type for WR47867: 2
2026-03-30 12:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b291864f-4aeb-5594-8014-0d540261bec6 with identifier: WR47867
2026-03-30 12:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b291864f-4aeb-5594-8014-0d540261bec6 with scrape type 2
2026-03-30 12:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b291864f-4aeb-5594-8014-0d540261bec6 with scrape type 2
2026-03-30 12:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b291864f-4aeb-5594-8014-0d540261bec6, identifier: WR47867
2026-03-30 12:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b291864f-4aeb-5594-8014-0d540261bec6 with identifier: WR47867
2026-03-30 12:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b291864f-4aeb-5594-8014-0d540261bec6 with identifier: WR47867
2026-03-30 12:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b291864f-4aeb-5594-8014-0d540261bec6 with identifier: WR47867 to the API
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:09:00Z',
'fuel_type': 'petrol',
'id': 'b291864f-4aeb-5594-8014-0d540261bec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR47867',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 116819,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-19',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR47867%27 HTTP/1.1" 200 None
2026-03-30 12:03:34 [auto1.fr] INFO: Saving data for WR47867: {'auction_closing_time': 1774969740.0, 'created_time': 1774624653.247258, 'last_price_update_time': 1774872214.668124}
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WR47867') HTTP/1.1" 204 0
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: ND41633
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: WJ51086
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: XT21215
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: AV23705
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: LK92723
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: VJ96213
2026-03-30 12:03:34 [auto1.fr] INFO: Found listing with ID: RP51827
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP51827%27 HTTP/1.1" 200 None
2026-03-30 12:03:34 [auto1.fr] INFO: Scrape type for RP51827: 2
2026-03-30 12:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b41d841-d47c-5456-adaf-bd934fef70bc with identifier: RP51827
2026-03-30 12:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b41d841-d47c-5456-adaf-bd934fef70bc with scrape type 2
2026-03-30 12:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b41d841-d47c-5456-adaf-bd934fef70bc with scrape type 2
2026-03-30 12:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b41d841-d47c-5456-adaf-bd934fef70bc, identifier: RP51827
2026-03-30 12:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b41d841-d47c-5456-adaf-bd934fef70bc with identifier: RP51827
2026-03-30 12:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b41d841-d47c-5456-adaf-bd934fef70bc with identifier: RP51827
2026-03-30 12:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b41d841-d47c-5456-adaf-bd934fef70bc with identifier: RP51827 to the API
2026-03-30 12:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:33:48Z',
'fuel_type': 'diesel',
'id': '7b41d841-d47c-5456-adaf-bd934fef70bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP51827',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 181976,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Auto-Ecole',
'transmission': 'manual',
'trim': 'Auto-Ecole',
'year': 2011}
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP51827%27 HTTP/1.1" 200 None
2026-03-30 12:03:35 [auto1.fr] INFO: Saving data for RP51827: {'auction_closing_time': 1774971228.0, 'created_time': 1774298066.78545, 'last_price_update_time': 1774872215.219759}
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP51827') HTTP/1.1" 204 0
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: PH85075
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: XA18023
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: HX86868
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: CX79974
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: TK98013
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: CB26112
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB26112%27 HTTP/1.1" 200 None
2026-03-30 12:03:35 [auto1.fr] INFO: Scrape type for CB26112: 1
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: AM79434
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: ES35993
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: JT67860
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: NK27352
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK27352%27 HTTP/1.1" 200 None
2026-03-30 12:03:35 [auto1.fr] INFO: Scrape type for NK27352: 0
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: HN32336
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: VH99245
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: WD02529
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: EP20272
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: VE02752
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: AZ90567
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: CL47015
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: KY03233
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: CW40670
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: JA68663
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: EP13062
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: KD39903
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: GZ25721
2026-03-30 12:03:35 [auto1.fr] INFO: Found listing with ID: JU04159
2026-03-30 12:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ48020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM05006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:45 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 5695 | hits on page: 40
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: ES16654
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES16654%27 HTTP/1.1" 200 None
2026-03-30 12:03:45 [auto1.fr] INFO: Scrape type for ES16654: 1
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: DE58917
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE58917%27 HTTP/1.1" 200 None
2026-03-30 12:03:45 [auto1.fr] INFO: Scrape type for DE58917: 2
2026-03-30 12:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with identifier: DE58917
2026-03-30 12:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with scrape type 2
2026-03-30 12:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with scrape type 2
2026-03-30 12:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7, identifier: DE58917
2026-03-30 12:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with identifier: DE58917
2026-03-30 12:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with identifier: DE58917
2026-03-30 12:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7 with identifier: DE58917 to the API
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-31T15:42:44Z',
'fuel_type': 'hybrid',
'id': '47e55626-0ae9-5ea1-ac2f-b5a1a014ebb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE58917',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 77080,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-14',
'seller_name': None,
'title': 'Renault Megane 1.6 E-Tech Hybrid R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2021}
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE58917%27 HTTP/1.1" 200 None
2026-03-30 12:03:45 [auto1.fr] INFO: Saving data for DE58917: {'auction_closing_time': 1774971764.0, 'created_time': 1773865005.987567, 'last_price_update_time': 1774872225.566955}
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE58917') HTTP/1.1" 204 0
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: PY17725
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: NW77264
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: SG94624
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: CL78536
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: YF33503
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: GF84131
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: EZ54447
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX76381%27 HTTP/1.1" 200 None
2026-03-30 12:03:45 [auto1.fr] INFO: Scrape type for VX76381: 1
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: PY80925
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: WW40675
2026-03-30 12:03:45 [auto1.fr] INFO: Found listing with ID: DK33853
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK33853%27 HTTP/1.1" 200 None
2026-03-30 12:03:45 [auto1.fr] INFO: Scrape type for DK33853: 2
2026-03-30 12:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48351c3a-102d-5a2a-a866-d277b5ff04f0 with identifier: DK33853
2026-03-30 12:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48351c3a-102d-5a2a-a866-d277b5ff04f0 with scrape type 2
2026-03-30 12:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48351c3a-102d-5a2a-a866-d277b5ff04f0 with scrape type 2
2026-03-30 12:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48351c3a-102d-5a2a-a866-d277b5ff04f0, identifier: DK33853
2026-03-30 12:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48351c3a-102d-5a2a-a866-d277b5ff04f0 with identifier: DK33853
2026-03-30 12:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48351c3a-102d-5a2a-a866-d277b5ff04f0 with identifier: DK33853
2026-03-30 12:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48351c3a-102d-5a2a-a866-d277b5ff04f0 with identifier: DK33853 to the API
2026-03-30 12:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:53:44Z',
'fuel_type': 'diesel',
'id': '48351c3a-102d-5a2a-a866-d277b5ff04f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK33853',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 202697,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-17',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2014}
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK33853%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Saving data for DK33853: {'auction_closing_time': 1774972424.0, 'created_time': 1774278761.984726, 'last_price_update_time': 1774872226.14178}
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK33853') HTTP/1.1" 204 0
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: UL02558
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: WB66153
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB66153%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for WB66153: 1
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: NF20338
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: NL19951
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: HY90819
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: MB48414
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB48414%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for MB48414: 2
2026-03-30 12:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a33e2d05-5165-5483-a5ec-bbc6b36363fb with identifier: MB48414
2026-03-30 12:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a33e2d05-5165-5483-a5ec-bbc6b36363fb with scrape type 2
2026-03-30 12:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a33e2d05-5165-5483-a5ec-bbc6b36363fb with scrape type 2
2026-03-30 12:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a33e2d05-5165-5483-a5ec-bbc6b36363fb, identifier: MB48414
2026-03-30 12:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a33e2d05-5165-5483-a5ec-bbc6b36363fb with identifier: MB48414
2026-03-30 12:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a33e2d05-5165-5483-a5ec-bbc6b36363fb with identifier: MB48414
2026-03-30 12:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a33e2d05-5165-5483-a5ec-bbc6b36363fb with identifier: MB48414 to the API
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:58:05Z',
'fuel_type': 'diesel',
'id': 'a33e2d05-5165-5483-a5ec-bbc6b36363fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB48414',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 191051,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-23',
'seller_name': None,
'title': 'Ford Grand C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB48414%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Saving data for MB48414: {'auction_closing_time': 1774972685.0, 'created_time': 1773865220.045864, 'last_price_update_time': 1774872226.745413}
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB48414') HTTP/1.1" 204 0
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: AB78144
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: RX71466
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: ZC78269
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: PE80694
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: RS22813
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: RK79359
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK79359%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for RK79359: 1
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: UT77845
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: PK45621
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK45621%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for PK45621: 1
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: AC65647
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: RG17064
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG17064%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for RG17064: 1
2026-03-30 12:03:46 [auto1.fr] INFO: Found listing with ID: UA69739
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA69739%27 HTTP/1.1" 200 None
2026-03-30 12:03:46 [auto1.fr] INFO: Scrape type for UA69739: 2
2026-03-30 12:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce867452-705e-598d-bec8-7f5c9c30492d with identifier: UA69739
2026-03-30 12:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce867452-705e-598d-bec8-7f5c9c30492d with scrape type 2
2026-03-30 12:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce867452-705e-598d-bec8-7f5c9c30492d with scrape type 2
2026-03-30 12:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce867452-705e-598d-bec8-7f5c9c30492d, identifier: UA69739
2026-03-30 12:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce867452-705e-598d-bec8-7f5c9c30492d with identifier: UA69739
2026-03-30 12:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce867452-705e-598d-bec8-7f5c9c30492d with identifier: UA69739
2026-03-30 12:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce867452-705e-598d-bec8-7f5c9c30492d with identifier: UA69739 to the API
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:16:53Z',
'fuel_type': 'petrol',
'id': 'ce867452-705e-598d-bec8-7f5c9c30492d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA69739',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 143330,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-06',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2018}
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA69739%27 HTTP/1.1" 200 None
2026-03-30 12:03:47 [auto1.fr] INFO: Saving data for UA69739: {'auction_closing_time': 1774970213.0, 'created_time': 1773865213.858721, 'last_price_update_time': 1774872227.423217}
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA69739') HTTP/1.1" 204 0
2026-03-30 12:03:47 [auto1.fr] INFO: Found listing with ID: KW43431
2026-03-30 12:03:47 [auto1.fr] INFO: Found listing with ID: KN07283
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN07283%27 HTTP/1.1" 200 None
2026-03-30 12:03:47 [auto1.fr] INFO: Scrape type for KN07283: 2
2026-03-30 12:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 074986b9-8808-59ac-b566-283f660c9cad with identifier: KN07283
2026-03-30 12:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 074986b9-8808-59ac-b566-283f660c9cad with scrape type 2
2026-03-30 12:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 074986b9-8808-59ac-b566-283f660c9cad with scrape type 2
2026-03-30 12:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 074986b9-8808-59ac-b566-283f660c9cad, identifier: KN07283
2026-03-30 12:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 074986b9-8808-59ac-b566-283f660c9cad with identifier: KN07283
2026-03-30 12:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 074986b9-8808-59ac-b566-283f660c9cad with identifier: KN07283
2026-03-30 12:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 074986b9-8808-59ac-b566-283f660c9cad with identifier: KN07283 to the API
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:24:03Z',
'fuel_type': 'petrol',
'id': '074986b9-8808-59ac-b566-283f660c9cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN07283',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 149111,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-29',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN07283%27 HTTP/1.1" 200 None
2026-03-30 12:03:48 [auto1.fr] INFO: Saving data for KN07283: {'auction_closing_time': 1774970643.0, 'created_time': 1773662415.481883, 'last_price_update_time': 1774872228.045492}
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KN07283') HTTP/1.1" 204 0
2026-03-30 12:03:48 [auto1.fr] INFO: Found listing with ID: GT72256
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT72256%27 HTTP/1.1" 200 None
2026-03-30 12:03:48 [auto1.fr] INFO: Scrape type for GT72256: 2
2026-03-30 12:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with identifier: GT72256
2026-03-30 12:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with scrape type 2
2026-03-30 12:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with scrape type 2
2026-03-30 12:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014, identifier: GT72256
2026-03-30 12:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with identifier: GT72256
2026-03-30 12:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with identifier: GT72256
2026-03-30 12:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2228aca2-b1a5-5f4f-a50f-4cadd8fcd014 with identifier: GT72256 to the API
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:38:08Z',
'fuel_type': 'petrol',
'id': '2228aca2-b1a5-5f4f-a50f-4cadd8fcd014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT72256',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 175686,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-21',
'seller_name': None,
'title': 'Seat Leon 1.0 eTSI Style Business',
'transmission': 'automatic',
'trim': 'Style Business',
'year': 2021}
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT72256%27 HTTP/1.1" 200 None
2026-03-30 12:03:48 [auto1.fr] INFO: Saving data for GT72256: {'auction_closing_time': 1774971488.0, 'created_time': 1773144162.258239, 'last_price_update_time': 1774872228.475799}
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT72256') HTTP/1.1" 204 0
2026-03-30 12:03:48 [auto1.fr] INFO: Found listing with ID: MH50218
2026-03-30 12:03:48 [auto1.fr] INFO: Found listing with ID: YJ92364
2026-03-30 12:03:48 [auto1.fr] INFO: Found listing with ID: EY29396
2026-03-30 12:03:48 [auto1.fr] INFO: Found listing with ID: VN71895
2026-03-30 12:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK41383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:58 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 15 pages/min), scraped 107 items (at 18 items/min)
2026-03-30 12:03:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ48020> (referer: https://www.auto1.com/v1/car-details-view/CZ48020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925 with identifier: CZ48020
2026-03-30 12:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925 with scrape type 1
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_d6eebfcacd464e82d13b580e4d060126.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_d6eebfcacd464e82d13b580e4d060126.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_bcdf538bd916da09244731ee8217b011.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bcdf538bd916da09244731ee8217b011.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_9c3c1f6ce17ad59c3aac55b867f92b5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_9c3c1f6ce17ad59c3aac55b867f92b5c.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_b77e6de72c0aaa1ab806e710cd1b95b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_b77e6de72c0aaa1ab806e710cd1b95b7.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_f329ff4e0674edbe68c8028ec46d4948.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_f329ff4e0674edbe68c8028ec46d4948.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_bf59011413ca70be0db21d0844bfbf1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bf59011413ca70be0db21d0844bfbf1d.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_21fa0eabdcc6bdd856328f2c86f07878.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_21fa0eabdcc6bdd856328f2c86f07878.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_e475a3f76b2191c51062ec009c88e5ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_e475a3f76b2191c51062ec009c88e5ec.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_2fae67a229d908a3e56373d8dc700526.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_2fae67a229d908a3e56373d8dc700526.jpg already downloaded
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fdf%252F5ddf5c227462ebeaf73ec0db6d4f12bf%252Fpa%252FCZ48020_913f6d2aa35a84aa6720704ea082a07e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_913f6d2aa35a84aa6720704ea082a07e.jpg already downloaded
2026-03-30 12:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925, identifier: CZ48020
2026-03-30 12:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925 with identifier: CZ48020
2026-03-30 12:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925 with identifier: CZ48020
2026-03-30 12:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4d5c4086-e33f-5d5a-a4fa-10d9d91b2925 with identifier: CZ48020 to the API
2026-03-30 12:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ48020>
{'auction_title': '',
'c_o_2_emission_value': 82,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:38:15Z',
'fuel_type': 'diesel',
'id': '4d5c4086-e33f-5d5a-a4fa-10d9d91b2925',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ48020',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Renault',
'model': 'Clio',
'odometer': 159824,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_d6eebfcacd464e82d13b580e4d060126.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bcdf538bd916da09244731ee8217b011.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_9c3c1f6ce17ad59c3aac55b867f92b5c.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_b77e6de72c0aaa1ab806e710cd1b95b7.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_f329ff4e0674edbe68c8028ec46d4948.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bf59011413ca70be0db21d0844bfbf1d.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_21fa0eabdcc6bdd856328f2c86f07878.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_e475a3f76b2191c51062ec009c88e5ec.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_2fae67a229d908a3e56373d8dc700526.jpg',
'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_913f6d2aa35a84aa6720704ea082a07e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_d6eebfcacd464e82d13b580e4d060126.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bcdf538bd916da09244731ee8217b011.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3338402,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_9c3c1f6ce17ad59c3aac55b867f92b5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495706,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_b77e6de72c0aaa1ab806e710cd1b95b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_f329ff4e0674edbe68c8028ec46d4948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_bf59011413ca70be0db21d0844bfbf1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_21fa0eabdcc6bdd856328f2c86f07878.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3198295,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_e475a3f76b2191c51062ec009c88e5ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_2fae67a229d908a3e56373d8dc700526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d5c4086-e33f-5d5a-a4fa-10d9d91b2925/4d5c4086-e33f-5d5a-a4fa-10d9d91b2925_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3246909,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/df/5ddf5c227462ebeaf73ec0db6d4f12bf/pa/CZ48020_913f6d2aa35a84aa6720704ea082a07e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-17',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2016}
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ48020%27 HTTP/1.1" 200 None
2026-03-30 12:04:04 [auto1.fr] INFO: Saving data for CZ48020: {'created_time': 1774872244.17363, 'last_price_update_time': 1774872244.173639, 'auction_closing_time': 1774971495.0}
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ48020') HTTP/1.1" 204 0
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM05006> (referer: https://www.auto1.com/v1/car-details-view/SM05006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with identifier: SM05006
2026-03-30 12:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with scrape type 1
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg not downloaded yet
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg not downloaded yet
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg not downloaded yet
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg not downloaded yet
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg not downloaded yet
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b6a10>
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg saved to cache
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB26112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850e8150>
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg saved to cache
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879df690>
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg saved to cache
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728512f810>
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg saved to cache
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a02350>
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fb0%252F41b04381a46a4cd0bf97553931230bec%252Fpa%252FSM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg') HTTP/1.1" 204 0
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg saved to cache
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80
2026-03-30 12:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80, skipping ID generation
2026-03-30 12:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with scrape type 1
2026-03-30 12:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 sending to next pipeline
2026-03-30 12:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80, identifier: SM05006
2026-03-30 12:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with identifier: SM05006
2026-03-30 12:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with identifier: SM05006
2026-03-30 12:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80 with identifier: SM05006 to the API
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:37:10Z',
'fuel_type': 'diesel',
'id': '88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM05006',
'listing': 'auction',
'location': 'FR, La Garde',
'make': 'Peugeot',
'model': '208',
'odometer': 191519,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7c0e7a66c9d916d3f54bd1b0809c8c25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_7b9cc7d866f1f4aeb6b29b4a5a06e906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_0d7ae3326b35fa2cbac8fb01a3030400.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_65a60d4e29e922a01aafffb6309e0a7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80/88c8e8a1-f55f-51dd-aa7f-bbc2b0c24c80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/b0/41b04381a46a4cd0bf97553931230bec/pa/SM05006_eeebfb0c9eb26a1ed776b39bfb7d0d00.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM05006%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [auto1.fr] INFO: Saving data for SM05006: {'created_time': 1774872246.809171, 'last_price_update_time': 1774872246.809181, 'auction_closing_time': 1774971430.0}
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM05006') HTTP/1.1" 204 0
2026-03-30 12:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES16654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:06 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 5697 | hits on page: 40
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: EY29396
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: VN71895
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: FX07138
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: HW58466
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW58466%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [auto1.fr] INFO: Scrape type for HW58466: 1
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: MD91591
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: XA31897
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: XL96735
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: FG22650
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG22650%27 HTTP/1.1" 200 None
2026-03-30 12:04:06 [auto1.fr] INFO: Scrape type for FG22650: 1
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: JA21075
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: JV74591
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: SD17416
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: CZ33179
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: XB50119
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: WU92358
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: BD23693
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: PH25199
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: JJ00045
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: GH15305
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: ZV76946
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: PY79941
2026-03-30 12:04:06 [auto1.fr] INFO: Found listing with ID: KH65686
2026-03-30 12:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH65686%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for KH65686: 0
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: FG40566
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: MC27609
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC27609%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for MC27609: 1
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: WP31416
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: YH69982
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: YN92407
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: GC01240
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: VF41194
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF41194%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for VF41194: 2
2026-03-30 12:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff3ef46-68fb-5326-8586-80bee6186c17 with identifier: VF41194
2026-03-30 12:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff3ef46-68fb-5326-8586-80bee6186c17 with scrape type 2
2026-03-30 12:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff3ef46-68fb-5326-8586-80bee6186c17 with scrape type 2
2026-03-30 12:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dff3ef46-68fb-5326-8586-80bee6186c17, identifier: VF41194
2026-03-30 12:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dff3ef46-68fb-5326-8586-80bee6186c17 with identifier: VF41194
2026-03-30 12:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dff3ef46-68fb-5326-8586-80bee6186c17 with identifier: VF41194
2026-03-30 12:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dff3ef46-68fb-5326-8586-80bee6186c17 with identifier: VF41194 to the API
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:01:45Z',
'fuel_type': 'diesel',
'id': 'dff3ef46-68fb-5326-8586-80bee6186c17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF41194',
'listing': 'auction',
'make': 'Citroen',
'model': 'C2',
'odometer': 246789,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-29',
'seller_name': None,
'title': 'Citroen C2 1.4 HDi Pulp',
'transmission': 'manual',
'trim': 'Pulp',
'year': 2006}
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF41194%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Saving data for VF41194: {'auction_closing_time': 1774969305.0, 'created_time': 1774353208.424134, 'last_price_update_time': 1774872247.484586}
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VF41194') HTTP/1.1" 204 0
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: DB59930
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: AB15378
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: VV69981
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: TK36036
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: BM86570
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM86570%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for BM86570: 1
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: BX30408
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: FR75409
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR75409%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for FR75409: 1
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: EJ56580
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ56580%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for EJ56580: 1
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: YJ70488
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: SS19249
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: ST02025
2026-03-30 12:04:07 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS25944%27 HTTP/1.1" 200 None
2026-03-30 12:04:07 [auto1.fr] INFO: Scrape type for PS25944: 1
2026-03-30 12:04:42 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.432(s), this was the 1st time calling it.
2026-03-30 12:04:42 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.0808762825497364 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:04:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.816(s), this was the 2nd time calling it.
2026-03-30 12:04:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.666434419340161 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN95140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK79359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:04:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:04:58 [scrapy.extensions.logstats] INFO: Crawled 106 pages (at 7 pages/min), scraped 110 items (at 3 items/min)
2026-03-30 12:04:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:05:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.310(s), this was the 2nd time calling it.
2026-03-30 12:05:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.298667316383144 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK45621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.680(s), this was the 1st time calling it.
2026-03-30 12:05:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.2350018973420145 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN44721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB12408> (referer: https://www.auto1.com/v1/car-details-view/YB12408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af54aade-0852-5705-aed6-9a2649c2ed4c with identifier: YB12408
2026-03-30 12:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af54aade-0852-5705-aed6-9a2649c2ed4c with scrape type 1
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af54aade-0852-5705-aed6-9a2649c2ed4c
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_a8fb7a5e328b0f73dcdb7e01ddb1c432.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_a8fb7a5e328b0f73dcdb7e01ddb1c432.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_e9df78d4f6707bf2c1a309463214d988.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_e9df78d4f6707bf2c1a309463214d988.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_207020dda9e296ec4befc1e18b2e8fbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_207020dda9e296ec4befc1e18b2e8fbc.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_d7f7f76399146780713dbd2c66db4f71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d7f7f76399146780713dbd2c66db4f71.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_d782df9a3ccde429460325fc960c214b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d782df9a3ccde429460325fc960c214b.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_05925fa670e14a096cdfbd2e701801b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_05925fa670e14a096cdfbd2e701801b8.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_94e0d67e52cd11a374e850554ba04b0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_94e0d67e52cd11a374e850554ba04b0e.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_64608b8d8c8608d199912366b291a64c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_64608b8d8c8608d199912366b291a64c.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_d3be9233aac3ad08f35bb9345250341a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d3be9233aac3ad08f35bb9345250341a.jpg already downloaded
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fab%252F1dab47754b867f819a8aec51d0c351ba%252Fpa%252FYB12408_bda30ea49a3e254e25074df604417c1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_bda30ea49a3e254e25074df604417c1b.jpg already downloaded
2026-03-30 12:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af54aade-0852-5705-aed6-9a2649c2ed4c, identifier: YB12408
2026-03-30 12:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af54aade-0852-5705-aed6-9a2649c2ed4c with identifier: YB12408
2026-03-30 12:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af54aade-0852-5705-aed6-9a2649c2ed4c with identifier: YB12408
2026-03-30 12:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af54aade-0852-5705-aed6-9a2649c2ed4c with identifier: YB12408 to the API
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB12408>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:42:54Z',
'fuel_type': 'petrol',
'id': 'af54aade-0852-5705-aed6-9a2649c2ed4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB12408',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Ford',
'model': 'Focus',
'odometer': 116922,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_a8fb7a5e328b0f73dcdb7e01ddb1c432.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_e9df78d4f6707bf2c1a309463214d988.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_207020dda9e296ec4befc1e18b2e8fbc.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d7f7f76399146780713dbd2c66db4f71.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d782df9a3ccde429460325fc960c214b.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_05925fa670e14a096cdfbd2e701801b8.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_94e0d67e52cd11a374e850554ba04b0e.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_64608b8d8c8608d199912366b291a64c.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d3be9233aac3ad08f35bb9345250341a.jpg',
'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_bda30ea49a3e254e25074df604417c1b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_a8fb7a5e328b0f73dcdb7e01ddb1c432.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_e9df78d4f6707bf2c1a309463214d988.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_207020dda9e296ec4befc1e18b2e8fbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d7f7f76399146780713dbd2c66db4f71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2896629,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d782df9a3ccde429460325fc960c214b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_05925fa670e14a096cdfbd2e701801b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_94e0d67e52cd11a374e850554ba04b0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3080119,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_64608b8d8c8608d199912366b291a64c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_d3be9233aac3ad08f35bb9345250341a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af54aade-0852-5705-aed6-9a2649c2ed4c/af54aade-0852-5705-aed6-9a2649c2ed4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/ab/1dab47754b867f819a8aec51d0c351ba/pa/YB12408_bda30ea49a3e254e25074df604417c1b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB12408%27 HTTP/1.1" 200 None
2026-03-30 12:05:10 [auto1.fr] INFO: Saving data for YB12408: {'created_time': 1774872310.8737, 'last_price_update_time': 1774872310.873716, 'auction_closing_time': 1774971774.0}
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB12408') HTTP/1.1" 204 0
2026-03-30 12:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB26112> (referer: https://www.auto1.com/v1/car-details-view/CB26112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1013f2fe-7606-500e-9679-05298bbe372a with identifier: CB26112
2026-03-30 12:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1013f2fe-7606-500e-9679-05298bbe372a with scrape type 1
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_24d204e34d9015732709e1384165f894.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_24d204e34d9015732709e1384165f894.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_a7e1735b80c1bffe33720171d68a095d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_a7e1735b80c1bffe33720171d68a095d.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_f07adf0d4e5277230030eab73ba37c6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_f07adf0d4e5277230030eab73ba37c6e.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_0c4100a6c52ca985236ea52bbe46b445.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_0c4100a6c52ca985236ea52bbe46b445.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg not downloaded yet
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg not downloaded yet
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG17064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879d2290>
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg saved to cache
2026-03-30 12:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:16 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 5698 | hits on page: 40
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES16654> (referer: https://www.auto1.com/v1/car-details-view/ES16654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: RX64079
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: PT96039
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: MG58458
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: JG14972
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG14972%27 HTTP/1.1" 200 None
2026-03-30 12:05:16 [auto1.fr] INFO: Scrape type for JG14972: 2
2026-03-30 12:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with identifier: JG14972
2026-03-30 12:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with scrape type 2
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with scrape type 2
2026-03-30 12:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5ca4805-cd1e-5845-ae54-cc4b0abcb040, identifier: JG14972
2026-03-30 12:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with identifier: JG14972
2026-03-30 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with identifier: JG14972
2026-03-30 12:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5ca4805-cd1e-5845-ae54-cc4b0abcb040 with identifier: JG14972 to the API
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:45:43Z',
'fuel_type': 'diesel',
'id': 'd5ca4805-cd1e-5845-ae54-cc4b0abcb040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG14972',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 224258,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-26',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Millenium Business',
'transmission': 'manual',
'trim': 'Millenium Business',
'year': 2018}
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG14972%27 HTTP/1.1" 200 None
2026-03-30 12:05:16 [auto1.fr] INFO: Saving data for JG14972: {'auction_closing_time': 1774971943.0, 'created_time': 1773691856.283991, 'last_price_update_time': 1774872316.781372}
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG14972') HTTP/1.1" 204 0
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: WB68155
2026-03-30 12:05:16 [auto1.fr] INFO: Found listing with ID: AX54768
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX54768%27 HTTP/1.1" 200 None
2026-03-30 12:05:16 [auto1.fr] INFO: Scrape type for AX54768: 2
2026-03-30 12:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c134a65-5220-5110-9b0e-f0e46a53643b with identifier: AX54768
2026-03-30 12:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c134a65-5220-5110-9b0e-f0e46a53643b with scrape type 2
2026-03-30 12:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c134a65-5220-5110-9b0e-f0e46a53643b with scrape type 2
2026-03-30 12:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c134a65-5220-5110-9b0e-f0e46a53643b, identifier: AX54768
2026-03-30 12:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c134a65-5220-5110-9b0e-f0e46a53643b with identifier: AX54768
2026-03-30 12:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c134a65-5220-5110-9b0e-f0e46a53643b with identifier: AX54768
2026-03-30 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c134a65-5220-5110-9b0e-f0e46a53643b with identifier: AX54768 to the API
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:01:42Z',
'fuel_type': 'diesel',
'id': '1c134a65-5220-5110-9b0e-f0e46a53643b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX54768',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 214123,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-12',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX54768%27 HTTP/1.1" 200 None
2026-03-30 12:05:17 [auto1.fr] INFO: Saving data for AX54768: {'auction_closing_time': 1774969302.0, 'created_time': 1774279232.295811, 'last_price_update_time': 1774872317.287256}
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX54768') HTTP/1.1" 204 0
2026-03-30 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804c468d-f5fb-59e9-b8f2-59d20713101e with identifier: ES16654
2026-03-30 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804c468d-f5fb-59e9-b8f2-59d20713101e with scrape type 1
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_7c6ae487279451f6b3be12c14161f089.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c6ae487279451f6b3be12c14161f089.jpg not downloaded yet
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: VT05411
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: YV32502
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: JA45555
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: FY62373
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: GE73125
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: BC58235
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: XV47033
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: NP19915
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP19915%27 HTTP/1.1" 200 None
2026-03-30 12:05:17 [auto1.fr] INFO: Scrape type for NP19915: 2
2026-03-30 12:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca885992-eeba-5f54-82fc-fa5f3cb5c44e with identifier: NP19915
2026-03-30 12:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca885992-eeba-5f54-82fc-fa5f3cb5c44e with scrape type 2
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca885992-eeba-5f54-82fc-fa5f3cb5c44e with scrape type 2
2026-03-30 12:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca885992-eeba-5f54-82fc-fa5f3cb5c44e, identifier: NP19915
2026-03-30 12:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca885992-eeba-5f54-82fc-fa5f3cb5c44e with identifier: NP19915
2026-03-30 12:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca885992-eeba-5f54-82fc-fa5f3cb5c44e with identifier: NP19915
2026-03-30 12:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca885992-eeba-5f54-82fc-fa5f3cb5c44e with identifier: NP19915 to the API
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:34:00Z',
'fuel_type': 'diesel',
'id': 'ca885992-eeba-5f54-82fc-fa5f3cb5c44e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP19915',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 222089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-09',
'seller_name': None,
'title': 'Chevrolet Captiva 2.2 Diesel D LTZ 4WD',
'transmission': 'manual',
'trim': 'D LTZ 4WD',
'year': 2012}
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP19915%27 HTTP/1.1" 200 None
2026-03-30 12:05:17 [auto1.fr] INFO: Saving data for NP19915: {'auction_closing_time': 1774971240.0, 'created_time': 1773121262.172303, 'last_price_update_time': 1774872317.857678}
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP19915') HTTP/1.1" 204 0
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_6819e994653cea2b2d7cd30ac5795344.png%27 HTTP/1.1" 200 None
2026-03-30 12:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6819e994653cea2b2d7cd30ac5795344.png not downloaded yet
2026-03-30 12:05:17 [auto1.fr] INFO: Found listing with ID: PH75787
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH75787%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.fr] INFO: Scrape type for PH75787: 1
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b6650>
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg saved to cache
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg not downloaded yet
2026-03-30 12:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_0c4100a6c52ca985236ea52bbe46b445.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: AF42565
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: VV35925
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: LC59253
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: NE46775
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: TY43577
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: XV86490
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: FX33595
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX33595%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.fr] INFO: Scrape type for FX33595: 2
2026-03-30 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-03-30 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b30bad-bc43-542a-b30a-603066b40c22 with scrape type 2
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b30bad-bc43-542a-b30a-603066b40c22 with scrape type 2
2026-03-30 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10b30bad-bc43-542a-b30a-603066b40c22, identifier: FX33595
2026-03-30 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-03-30 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595
2026-03-30 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10b30bad-bc43-542a-b30a-603066b40c22 with identifier: FX33595 to the API
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:35:04Z',
'fuel_type': 'diesel',
'id': '10b30bad-bc43-542a-b30a-603066b40c22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX33595',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 252054,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2010}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX33595%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.fr] INFO: Saving data for FX33595: {'auction_closing_time': 1774971304.0, 'created_time': 1773693894.694381, 'last_price_update_time': 1774872318.573331}
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX33595') HTTP/1.1" 204 0
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_6fe182542074be41d321392e6e083c83.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6fe182542074be41d321392e6e083c83.jpg not downloaded yet
2026-03-30 12:05:18 [auto1.fr] INFO: Found listing with ID: CG96901
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG96901%27 HTTP/1.1" 200 None
2026-03-30 12:05:18 [auto1.fr] INFO: Scrape type for CG96901: 2
2026-03-30 12:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f76bb11-6070-5680-92f6-9866a94dd31b with identifier: CG96901
2026-03-30 12:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f76bb11-6070-5680-92f6-9866a94dd31b with scrape type 2
2026-03-30 12:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f76bb11-6070-5680-92f6-9866a94dd31b with scrape type 2
2026-03-30 12:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f76bb11-6070-5680-92f6-9866a94dd31b, identifier: CG96901
2026-03-30 12:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f76bb11-6070-5680-92f6-9866a94dd31b with identifier: CG96901
2026-03-30 12:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f76bb11-6070-5680-92f6-9866a94dd31b with identifier: CG96901
2026-03-30 12:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f76bb11-6070-5680-92f6-9866a94dd31b with identifier: CG96901 to the API
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:01:58Z',
'fuel_type': 'petrol',
'id': '9f76bb11-6070-5680-92f6-9866a94dd31b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG96901',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 64644,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-20',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG96901%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [auto1.fr] INFO: Saving data for CG96901: {'auction_closing_time': 1774969318.0, 'created_time': 1774253427.461219, 'last_price_update_time': 1774872319.048053}
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CG96901') HTTP/1.1" 204 0
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_7c22453b53892376c516cbcdfcef7e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c22453b53892376c516cbcdfcef7e0a.jpg not downloaded yet
2026-03-30 12:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a29290>
2026-03-30 12:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_0c4100a6c52ca985236ea52bbe46b445.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_0c4100a6c52ca985236ea52bbe46b445.jpg saved to cache
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: KE60307
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE60307%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [auto1.fr] INFO: Scrape type for KE60307: 1
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_1edde1ad72adecd441e86b11dd15b428.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_1edde1ad72adecd441e86b11dd15b428.jpg not downloaded yet
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: ET54199
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: JC74188
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: BD23405
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: ME79644
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: SA42500
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: CE57838
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE57838%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [auto1.fr] INFO: Scrape type for CE57838: 2
2026-03-30 12:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd031e7-1c22-5a65-80f0-682dc2e1d18f with identifier: CE57838
2026-03-30 12:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd031e7-1c22-5a65-80f0-682dc2e1d18f with scrape type 2
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd031e7-1c22-5a65-80f0-682dc2e1d18f with scrape type 2
2026-03-30 12:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcd031e7-1c22-5a65-80f0-682dc2e1d18f, identifier: CE57838
2026-03-30 12:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcd031e7-1c22-5a65-80f0-682dc2e1d18f with identifier: CE57838
2026-03-30 12:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcd031e7-1c22-5a65-80f0-682dc2e1d18f with identifier: CE57838
2026-03-30 12:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dcd031e7-1c22-5a65-80f0-682dc2e1d18f with identifier: CE57838 to the API
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:48:00Z',
'fuel_type': 'hybrid',
'id': 'dcd031e7-1c22-5a65-80f0-682dc2e1d18f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE57838',
'listing': 'auction',
'make': 'Peugeot',
'model': '408',
'odometer': 41237,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-19',
'seller_name': None,
'title': 'Peugeot 408 1.6 Hybrid GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2023}
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE57838%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [auto1.fr] INFO: Saving data for CE57838: {'auction_closing_time': 1774972080.0, 'created_time': 1774538569.30498, 'last_price_update_time': 1774872319.654126}
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE57838') HTTP/1.1" 204 0
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_9ac5f04ab9d4533b80f97876a1727005.png%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_9ac5f04ab9d4533b80f97876a1727005.png not downloaded yet
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: GZ24181
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: PY19050
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: NE95829
2026-03-30 12:05:19 [auto1.fr] INFO: Found listing with ID: JT01399
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT01399%27 HTTP/1.1" 200 None
2026-03-30 12:05:19 [auto1.fr] INFO: Scrape type for JT01399: 2
2026-03-30 12:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad4c6d8-48ca-533f-9d05-159ffd9df09d with identifier: JT01399
2026-03-30 12:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad4c6d8-48ca-533f-9d05-159ffd9df09d with scrape type 2
2026-03-30 12:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dad4c6d8-48ca-533f-9d05-159ffd9df09d with scrape type 2
2026-03-30 12:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dad4c6d8-48ca-533f-9d05-159ffd9df09d, identifier: JT01399
2026-03-30 12:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dad4c6d8-48ca-533f-9d05-159ffd9df09d with identifier: JT01399
2026-03-30 12:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dad4c6d8-48ca-533f-9d05-159ffd9df09d with identifier: JT01399
2026-03-30 12:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dad4c6d8-48ca-533f-9d05-159ffd9df09d with identifier: JT01399 to the API
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:44:39Z',
'fuel_type': 'diesel',
'id': 'dad4c6d8-48ca-533f-9d05-159ffd9df09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT01399',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 214438,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-26',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'automatic',
'trim': 'Scout 4x4',
'year': 2015}
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT01399%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [auto1.fr] INFO: Saving data for JT01399: {'auction_closing_time': 1774971879.0, 'created_time': 1774266770.017764, 'last_price_update_time': 1774872320.239842}
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JT01399') HTTP/1.1" 204 0
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_3db594e1ca90b0c8d147f8c531191b5d.png%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_3db594e1ca90b0c8d147f8c531191b5d.png not downloaded yet
2026-03-30 12:05:20 [auto1.fr] INFO: Found listing with ID: KY00599
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY00599%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [auto1.fr] INFO: Scrape type for KY00599: 1
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_8cbd962a533a6c96152374055a1051ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_8cbd962a533a6c96152374055a1051ed.jpg not downloaded yet
2026-03-30 12:05:20 [auto1.fr] INFO: Found listing with ID: WJ65165
2026-03-30 12:05:20 [auto1.fr] INFO: Found listing with ID: BR78024
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR78024%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [auto1.fr] INFO: Scrape type for BR78024: 1
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_f947eddc3957b8c58abeb08e9bf0c174.png%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_f947eddc3957b8c58abeb08e9bf0c174.png not downloaded yet
2026-03-30 12:05:20 [auto1.fr] INFO: Found listing with ID: ZT40530
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT40530%27 HTTP/1.1" 200 None
2026-03-30 12:05:20 [auto1.fr] INFO: Scrape type for ZT40530: 1
2026-03-30 12:05:20 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 12:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW58466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW53663> (referer: https://www.auto1.com/v1/car-details-view/UW53663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89ad912-3e3d-5259-a2ed-a53196a79348 with identifier: UW53663
2026-03-30 12:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89ad912-3e3d-5259-a2ed-a53196a79348 with scrape type 1
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f89ad912-3e3d-5259-a2ed-a53196a79348
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_c54589e14e5933328482f21fb95e0a67.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_c54589e14e5933328482f21fb95e0a67.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_b3cc4718cbffb976ce8a651ad8a0bca8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_b3cc4718cbffb976ce8a651ad8a0bca8.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_0ecc113fdbb13a7666580d7dc2dc0ee4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_0ecc113fdbb13a7666580d7dc2dc0ee4.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_afd02b473eb803f62a58b467908a7252.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_afd02b473eb803f62a58b467908a7252.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_dd02e0984036d365f34a26affaf8ba65.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_dd02e0984036d365f34a26affaf8ba65.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_5fe66ca1b27999e7a3bbf01f73ee4229.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_5fe66ca1b27999e7a3bbf01f73ee4229.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_6976ca2f3d5afc8b880612a4f35484a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6976ca2f3d5afc8b880612a4f35484a4.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_6a995176b81e2f4e230c689af70a009f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6a995176b81e2f4e230c689af70a009f.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_ab6037bd044be9da6fe86d8b5cc2543a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_ab6037bd044be9da6fe86d8b5cc2543a.jpg already downloaded
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F71%252F1f71b5a893f3b00d185d66fcc95afc2c%252Fpa%252FUW53663_da3fe6bcfe89f50ee429d75d919a805b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_da3fe6bcfe89f50ee429d75d919a805b.jpg already downloaded
2026-03-30 12:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f89ad912-3e3d-5259-a2ed-a53196a79348, identifier: UW53663
2026-03-30 12:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f89ad912-3e3d-5259-a2ed-a53196a79348 with identifier: UW53663
2026-03-30 12:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f89ad912-3e3d-5259-a2ed-a53196a79348 with identifier: UW53663
2026-03-30 12:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f89ad912-3e3d-5259-a2ed-a53196a79348 with identifier: UW53663 to the API
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW53663>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:17:18Z',
'fuel_type': 'diesel',
'id': 'f89ad912-3e3d-5259-a2ed-a53196a79348',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW53663',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Renault',
'model': 'Clio',
'odometer': 125458,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_c54589e14e5933328482f21fb95e0a67.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_b3cc4718cbffb976ce8a651ad8a0bca8.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_0ecc113fdbb13a7666580d7dc2dc0ee4.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_afd02b473eb803f62a58b467908a7252.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_dd02e0984036d365f34a26affaf8ba65.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_5fe66ca1b27999e7a3bbf01f73ee4229.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6976ca2f3d5afc8b880612a4f35484a4.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6a995176b81e2f4e230c689af70a009f.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_ab6037bd044be9da6fe86d8b5cc2543a.jpg',
'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_da3fe6bcfe89f50ee429d75d919a805b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293555,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_c54589e14e5933328482f21fb95e0a67.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284792,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_b3cc4718cbffb976ce8a651ad8a0bca8.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312384,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_0ecc113fdbb13a7666580d7dc2dc0ee4.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47820,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_afd02b473eb803f62a58b467908a7252.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52240,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_dd02e0984036d365f34a26affaf8ba65.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50936,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_5fe66ca1b27999e7a3bbf01f73ee4229.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285176,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6976ca2f3d5afc8b880612a4f35484a4.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292687,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_6a995176b81e2f4e230c689af70a009f.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285304,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_ab6037bd044be9da6fe86d8b5cc2543a.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89ad912-3e3d-5259-a2ed-a53196a79348/f89ad912-3e3d-5259-a2ed-a53196a79348_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48451,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img1f/71/1f71b5a893f3b00d185d66fcc95afc2c/pa/UW53663_da3fe6bcfe89f50ee429d75d919a805b.jpg',
'Width': 640}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2018}
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW53663%27 HTTP/1.1" 200 None
2026-03-30 12:05:29 [auto1.fr] INFO: Saving data for UW53663: {'created_time': 1774872329.751732, 'last_price_update_time': 1774872329.751744, 'auction_closing_time': 1774970238.0}
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UW53663') HTTP/1.1" 204 0
2026-03-30 12:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN95140> (referer: https://www.auto1.com/v1/car-details-view/CN95140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f11a372b-e25c-512c-aac3-fa8b2964837b with identifier: CN95140
2026-03-30 12:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f11a372b-e25c-512c-aac3-fa8b2964837b with scrape type 1
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f11a372b-e25c-512c-aac3-fa8b2964837b
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_55b8f1959b18c977e4812a2e05ccdfd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_55b8f1959b18c977e4812a2e05ccdfd9.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_dab6b4d1a413afc3baf6d09826dc79ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_dab6b4d1a413afc3baf6d09826dc79ee.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_f2cd3883ef290843e34bd85ceccdf24c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_f2cd3883ef290843e34bd85ceccdf24c.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_72524e3ec9089671ee81155e31627c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_72524e3ec9089671ee81155e31627c9f.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_299784bd213684c3f806f7f364bd277b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_299784bd213684c3f806f7f364bd277b.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_2d00dcdaa0474265787b13301a2eec1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_2d00dcdaa0474265787b13301a2eec1c.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_3f3bcd9c0923b834fbe38e0d090a420a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_3f3bcd9c0923b834fbe38e0d090a420a.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_992f4dcdc2cd3248254dfd6f8a22b98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_992f4dcdc2cd3248254dfd6f8a22b98d.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_380842d444fed5aef7d3801aa5d5279e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_380842d444fed5aef7d3801aa5d5279e.jpg already downloaded
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fac%252F0dac2faf737ce2270b7bb6b3e5532aef%252Fpa%252FCN95140_7ac117480e8f8cb0f8872f16cc75839e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_7ac117480e8f8cb0f8872f16cc75839e.jpg already downloaded
2026-03-30 12:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f11a372b-e25c-512c-aac3-fa8b2964837b, identifier: CN95140
2026-03-30 12:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f11a372b-e25c-512c-aac3-fa8b2964837b with identifier: CN95140
2026-03-30 12:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f11a372b-e25c-512c-aac3-fa8b2964837b with identifier: CN95140
2026-03-30 12:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f11a372b-e25c-512c-aac3-fa8b2964837b with identifier: CN95140 to the API
2026-03-30 12:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN95140>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 83,
'expiration_date': '2026-03-31T15:37:35Z',
'fuel_type': 'petrol',
'id': 'f11a372b-e25c-512c-aac3-fa8b2964837b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN95140',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 14910,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_55b8f1959b18c977e4812a2e05ccdfd9.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_dab6b4d1a413afc3baf6d09826dc79ee.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_f2cd3883ef290843e34bd85ceccdf24c.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_72524e3ec9089671ee81155e31627c9f.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_299784bd213684c3f806f7f364bd277b.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_2d00dcdaa0474265787b13301a2eec1c.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_3f3bcd9c0923b834fbe38e0d090a420a.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_992f4dcdc2cd3248254dfd6f8a22b98d.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_380842d444fed5aef7d3801aa5d5279e.jpg',
'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_7ac117480e8f8cb0f8872f16cc75839e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_55b8f1959b18c977e4812a2e05ccdfd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_dab6b4d1a413afc3baf6d09826dc79ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_f2cd3883ef290843e34bd85ceccdf24c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_72524e3ec9089671ee81155e31627c9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_299784bd213684c3f806f7f364bd277b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_2d00dcdaa0474265787b13301a2eec1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_3f3bcd9c0923b834fbe38e0d090a420a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_992f4dcdc2cd3248254dfd6f8a22b98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_380842d444fed5aef7d3801aa5d5279e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f11a372b-e25c-512c-aac3-fa8b2964837b/f11a372b-e25c-512c-aac3-fa8b2964837b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/ac/0dac2faf737ce2270b7bb6b3e5532aef/pa/CN95140_7ac117480e8f8cb0f8872f16cc75839e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-02-13',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Comfort+',
'transmission': 'manual',
'trim': 'Comfort+',
'year': 2024}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN95140%27 HTTP/1.1" 200 None
2026-03-30 12:05:32 [auto1.fr] INFO: Saving data for CN95140: {'created_time': 1774872332.679919, 'last_price_update_time': 1774872332.679984, 'auction_closing_time': 1774971455.0}
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN95140') HTTP/1.1" 204 0
2026-03-30 12:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_f947eddc3957b8c58abeb08e9bf0c174.png> (referer: https://www.auto1.com/)
2026-03-30 12:05:32 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:05:32 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:05:32 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc7bd0>
2026-03-30 12:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_9.png HTTP/1.1" 201 0
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_f947eddc3957b8c58abeb08e9bf0c174.png') HTTP/1.1" 204 0
2026-03-30 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_f947eddc3957b8c58abeb08e9bf0c174.png saved to cache
2026-03-30 12:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK41383> (referer: https://www.auto1.com/v1/car-details-view/GK41383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddba35e0-7535-5ce4-ac7c-6402a73308cc with identifier: GK41383
2026-03-30 12:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddba35e0-7535-5ce4-ac7c-6402a73308cc with scrape type 1
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_98460a50d3e39d07a00786de25b3c2af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_98460a50d3e39d07a00786de25b3c2af.jpg not downloaded yet
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg not downloaded yet
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_04e209aa2b00140c5c9483c4e320e68c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_04e209aa2b00140c5c9483c4e320e68c.jpg not downloaded yet
2026-03-30 12:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_8cbd962a533a6c96152374055a1051ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg not downloaded yet
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg not downloaded yet
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_fff95e6ff400eb3c412ad29a169feecc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_fff95e6ff400eb3c412ad29a169feecc.jpg not downloaded yet
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc4050>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_8cbd962a533a6c96152374055a1051ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_8cbd962a533a6c96152374055a1051ed.jpg saved to cache
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_04e209aa2b00140c5c9483c4e320e68c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285141510>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_04e209aa2b00140c5c9483c4e320e68c.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_04e209aa2b00140c5c9483c4e320e68c.jpg saved to cache
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_fff95e6ff400eb3c412ad29a169feecc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285101ad0>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_fff95e6ff400eb3c412ad29a169feecc.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_fff95e6ff400eb3c412ad29a169feecc.jpg saved to cache
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aafd10>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg saved to cache
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285142950>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg saved to cache
2026-03-30 12:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_98460a50d3e39d07a00786de25b3c2af.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aae6d0>
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg saved to cache
2026-03-30 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c05f90>
2026-03-30 12:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fa8%252F5fa859a3cd08245c4b64ea3d32e5dbcf%252Fpa%252FGK41383_98460a50d3e39d07a00786de25b3c2af.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_98460a50d3e39d07a00786de25b3c2af.jpg saved to cache
2026-03-30 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddba35e0-7535-5ce4-ac7c-6402a73308cc
2026-03-30 12:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddba35e0-7535-5ce4-ac7c-6402a73308cc, skipping ID generation
2026-03-30 12:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddba35e0-7535-5ce4-ac7c-6402a73308cc with scrape type 1
2026-03-30 12:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddba35e0-7535-5ce4-ac7c-6402a73308cc sending to next pipeline
2026-03-30 12:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ddba35e0-7535-5ce4-ac7c-6402a73308cc, identifier: GK41383
2026-03-30 12:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ddba35e0-7535-5ce4-ac7c-6402a73308cc with identifier: GK41383
2026-03-30 12:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ddba35e0-7535-5ce4-ac7c-6402a73308cc with identifier: GK41383
2026-03-30 12:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ddba35e0-7535-5ce4-ac7c-6402a73308cc with identifier: GK41383 to the API
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_98460a50d3e39d07a00786de25b3c2af.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:25:01Z',
'fuel_type': 'petrol',
'id': 'ddba35e0-7535-5ce4-ac7c-6402a73308cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK41383',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'MINI',
'model': 'MINI',
'odometer': 169663,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_98460a50d3e39d07a00786de25b3c2af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_4aa0c106678ad6f841e4c57a26cdc5af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_04e209aa2b00140c5c9483c4e320e68c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_927b1c7805cabd3f9a0ba886b8d90d91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_a4f50ef2c4bfd3654d26357d0b07c3d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddba35e0-7535-5ce4-ac7c-6402a73308cc/ddba35e0-7535-5ce4-ac7c-6402a73308cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/a8/5fa859a3cd08245c4b64ea3d32e5dbcf/pa/GK41383_fff95e6ff400eb3c412ad29a169feecc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-01-04',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK41383%27 HTTP/1.1" 200 None
2026-03-30 12:05:43 [auto1.fr] INFO: Saving data for GK41383: {'created_time': 1774872343.559883, 'last_price_update_time': 1774872343.559896, 'auction_closing_time': 1774970701.0}
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GK41383') HTTP/1.1" 204 0
2026-03-30 12:05:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.195(s), this was the 1st time calling it.
2026-03-30 12:05:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.091001338540878 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.560(s), this was the 1st time calling it.
2026-03-30 12:05:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.502314957316849 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK79359> (referer: https://www.auto1.com/v1/car-details-view/RK79359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN44721> (referer: https://www.auto1.com/v1/car-details-view/MN44721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3025737b-bbf1-5c07-a5e5-a213bcda21d2 with identifier: RK79359
2026-03-30 12:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3025737b-bbf1-5c07-a5e5-a213bcda21d2 with scrape type 1
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3025737b-bbf1-5c07-a5e5-a213bcda21d2
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_d4324019e4356de1ff1af9169ff1387c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_d4324019e4356de1ff1af9169ff1387c.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_180058872822d6895210d5a649acbbff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_180058872822d6895210d5a649acbbff.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_b0af3e1bd132b8b0cc753c0be6d42794.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_b0af3e1bd132b8b0cc753c0be6d42794.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_aff8fdf2f9c7897e7a6337a5c4f225e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_aff8fdf2f9c7897e7a6337a5c4f225e2.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_594af564ba23183384cf3c82775e3167.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_594af564ba23183384cf3c82775e3167.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_fbadbd199f9c74abf176c2d37346060c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_fbadbd199f9c74abf176c2d37346060c.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_39706aa36f7310ad05788034bb292711.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_39706aa36f7310ad05788034bb292711.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_86c31a34a4934eb2611c20e670d06fa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_86c31a34a4934eb2611c20e670d06fa9.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_c8c1db608fcea0bc67f26ebb02cd6cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_c8c1db608fcea0bc67f26ebb02cd6cc4.jpg already downloaded
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fef%252Fd7ef196d4b1c688408471793b0c6561a%252Fpa%252FRK79359_89abdab4c34addf2e27bc306de27a1e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_89abdab4c34addf2e27bc306de27a1e8.jpg already downloaded
2026-03-30 12:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3025737b-bbf1-5c07-a5e5-a213bcda21d2, identifier: RK79359
2026-03-30 12:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3025737b-bbf1-5c07-a5e5-a213bcda21d2 with identifier: RK79359
2026-03-30 12:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3025737b-bbf1-5c07-a5e5-a213bcda21d2 with identifier: RK79359
2026-03-30 12:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3025737b-bbf1-5c07-a5e5-a213bcda21d2 with identifier: RK79359 to the API
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK79359>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:15:30Z',
'fuel_type': 'petrol',
'id': '3025737b-bbf1-5c07-a5e5-a213bcda21d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK79359',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Citroen',
'model': 'C3',
'odometer': 36053,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_d4324019e4356de1ff1af9169ff1387c.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_180058872822d6895210d5a649acbbff.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_b0af3e1bd132b8b0cc753c0be6d42794.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_aff8fdf2f9c7897e7a6337a5c4f225e2.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_594af564ba23183384cf3c82775e3167.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_fbadbd199f9c74abf176c2d37346060c.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_39706aa36f7310ad05788034bb292711.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_86c31a34a4934eb2611c20e670d06fa9.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_c8c1db608fcea0bc67f26ebb02cd6cc4.jpg',
'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_89abdab4c34addf2e27bc306de27a1e8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_d4324019e4356de1ff1af9169ff1387c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_180058872822d6895210d5a649acbbff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_b0af3e1bd132b8b0cc753c0be6d42794.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_aff8fdf2f9c7897e7a6337a5c4f225e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_594af564ba23183384cf3c82775e3167.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_fbadbd199f9c74abf176c2d37346060c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_39706aa36f7310ad05788034bb292711.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_86c31a34a4934eb2611c20e670d06fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_c8c1db608fcea0bc67f26ebb02cd6cc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3025737b-bbf1-5c07-a5e5-a213bcda21d2/3025737b-bbf1-5c07-a5e5-a213bcda21d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/ef/d7ef196d4b1c688408471793b0c6561a/pa/RK79359_89abdab4c34addf2e27bc306de27a1e8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK79359%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [auto1.fr] INFO: Saving data for RK79359: {'created_time': 1774872350.416851, 'last_price_update_time': 1774872350.416863, 'auction_closing_time': 1774970130.0}
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK79359') HTTP/1.1" 204 0
2026-03-30 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL33581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_3db594e1ca90b0c8d147f8c531191b5d.png> (referer: https://www.auto1.com/)
2026-03-30 12:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6bf0869-9575-5211-9e3f-5ce612085c47 with identifier: MN44721
2026-03-30 12:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6bf0869-9575-5211-9e3f-5ce612085c47 with scrape type 1
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c6bf0869-9575-5211-9e3f-5ce612085c47
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_d955c64579940c286310851d06f96e5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_d955c64579940c286310851d06f96e5d.jpg already downloaded
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_3d0796bc7db2a04eed0c577956acfa6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3d0796bc7db2a04eed0c577956acfa6e.jpg already downloaded
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_e0218f29f3e5c14a30543d8deaecf4be.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_e0218f29f3e5c14a30543d8deaecf4be.jpg already downloaded
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_3198532a7674a4422b6965aaae20192b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3198532a7674a4422b6965aaae20192b.jpg already downloaded
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_8a9681b500f95ebbdf72aecd0f932508.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_8a9681b500f95ebbdf72aecd0f932508.jpg already downloaded
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fed%252F90edb43a07a5ea9a978e71234dd5e49a%252Fpa%252FMN44721_fcc7ceff3ee805dc515364a7b1de1657.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_fcc7ceff3ee805dc515364a7b1de1657.jpg already downloaded
2026-03-30 12:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6bf0869-9575-5211-9e3f-5ce612085c47, identifier: MN44721
2026-03-30 12:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6bf0869-9575-5211-9e3f-5ce612085c47 with identifier: MN44721
2026-03-30 12:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6bf0869-9575-5211-9e3f-5ce612085c47 with identifier: MN44721
2026-03-30 12:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6bf0869-9575-5211-9e3f-5ce612085c47 with identifier: MN44721 to the API
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MN44721>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:44:03Z',
'fuel_type': 'diesel',
'id': 'c6bf0869-9575-5211-9e3f-5ce612085c47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN44721',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '208',
'odometer': 224837,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_d955c64579940c286310851d06f96e5d.jpg',
'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3d0796bc7db2a04eed0c577956acfa6e.jpg',
'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_e0218f29f3e5c14a30543d8deaecf4be.jpg',
'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3198532a7674a4422b6965aaae20192b.jpg',
'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_8a9681b500f95ebbdf72aecd0f932508.jpg',
'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_fcc7ceff3ee805dc515364a7b1de1657.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_d955c64579940c286310851d06f96e5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3d0796bc7db2a04eed0c577956acfa6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_e0218f29f3e5c14a30543d8deaecf4be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_3198532a7674a4422b6965aaae20192b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_8a9681b500f95ebbdf72aecd0f932508.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6bf0869-9575-5211-9e3f-5ce612085c47/c6bf0869-9575-5211-9e3f-5ce612085c47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/ed/90edb43a07a5ea9a978e71234dd5e49a/pa/MN44721_fcc7ceff3ee805dc515364a7b1de1657.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-05',
'seats_number': 2,
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Affaire Pack CD Clim',
'transmission': 'manual',
'trim': 'Affaire Pack CD Clim',
'year': 2013}
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN44721%27 HTTP/1.1" 200 None
2026-03-30 12:05:51 [auto1.fr] INFO: Saving data for MN44721: {'created_time': 1774872351.000347, 'last_price_update_time': 1774872351.000359, 'auction_closing_time': 1774971843.0}
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN44721') HTTP/1.1" 204 0
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a98690>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_7.png HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_3db594e1ca90b0c8d147f8c531191b5d.png') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_3db594e1ca90b0c8d147f8c531191b5d.png saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_9ac5f04ab9d4533b80f97876a1727005.png> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859e6ed0>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_6.png HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_9ac5f04ab9d4533b80f97876a1727005.png') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_9ac5f04ab9d4533b80f97876a1727005.png saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_1edde1ad72adecd441e86b11dd15b428.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285108b50>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_1edde1ad72adecd441e86b11dd15b428.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_1edde1ad72adecd441e86b11dd15b428.jpg saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c22453b53892376c516cbcdfcef7e0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285102c90>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_7c22453b53892376c516cbcdfcef7e0a.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c22453b53892376c516cbcdfcef7e0a.jpg saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6fe182542074be41d321392e6e083c83.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a32390>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_6fe182542074be41d321392e6e083c83.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6fe182542074be41d321392e6e083c83.jpg saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285159350>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg saved to cache
2026-03-30 12:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6819e994653cea2b2d7cd30ac5795344.png> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ56580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c6ae487279451f6b3be12c14161f089.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:05:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc65d0>
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_1.png HTTP/1.1" 201 0
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_6819e994653cea2b2d7cd30ac5795344.png') HTTP/1.1" 204 0
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6819e994653cea2b2d7cd30ac5795344.png saved to cache
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b7510>
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fa3%252F2ba3f22276df0179cb15f7c3e48bce2d%252Fpa%252FES16654_7c6ae487279451f6b3be12c14161f089.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c6ae487279451f6b3be12c14161f089.jpg saved to cache
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 804c468d-f5fb-59e9-b8f2-59d20713101e
2026-03-30 12:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 804c468d-f5fb-59e9-b8f2-59d20713101e, skipping ID generation
2026-03-30 12:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804c468d-f5fb-59e9-b8f2-59d20713101e with scrape type 1
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 804c468d-f5fb-59e9-b8f2-59d20713101e sending to next pipeline
2026-03-30 12:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 804c468d-f5fb-59e9-b8f2-59d20713101e, identifier: ES16654
2026-03-30 12:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 804c468d-f5fb-59e9-b8f2-59d20713101e with identifier: ES16654
2026-03-30 12:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 804c468d-f5fb-59e9-b8f2-59d20713101e with identifier: ES16654
2026-03-30 12:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 804c468d-f5fb-59e9-b8f2-59d20713101e with identifier: ES16654 to the API
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c6ae487279451f6b3be12c14161f089.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:39:55Z',
'fuel_type': 'diesel',
'id': '804c468d-f5fb-59e9-b8f2-59d20713101e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES16654',
'listing': 'auction',
'location': 'FR, Saint Herblain',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 75146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c6ae487279451f6b3be12c14161f089.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6819e994653cea2b2d7cd30ac5795344.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_a66d545486b7fa28a2c7cd1cf3ea4b73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_6fe182542074be41d321392e6e083c83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_7c22453b53892376c516cbcdfcef7e0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_1edde1ad72adecd441e86b11dd15b428.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_9ac5f04ab9d4533b80f97876a1727005.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_3db594e1ca90b0c8d147f8c531191b5d.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_8cbd962a533a6c96152374055a1051ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_804c468d-f5fb-59e9-b8f2-59d20713101e/804c468d-f5fb-59e9-b8f2-59d20713101e_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a3/2ba3f22276df0179cb15f7c3e48bce2d/pa/ES16654_f947eddc3957b8c58abeb08e9bf0c174.png',
'Width': 512}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-28',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2022}
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES16654%27 HTTP/1.1" 200 None
2026-03-30 12:05:52 [auto1.fr] INFO: Saving data for ES16654: {'created_time': 1774872352.793191, 'last_price_update_time': 1774872352.793207, 'auction_closing_time': 1774971595.0}
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ES16654') HTTP/1.1" 204 0
2026-03-30 12:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_f07adf0d4e5277230030eab73ba37c6e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aaefd0>
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg saved to cache
2026-03-30 12:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285abccd0>
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_f07adf0d4e5277230030eab73ba37c6e.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_f07adf0d4e5277230030eab73ba37c6e.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c640d0>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_a7e1735b80c1bffe33720171d68a095d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a316d0>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_a7e1735b80c1bffe33720171d68a095d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_a7e1735b80c1bffe33720171d68a095d.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_24d204e34d9015732709e1384165f894.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a9590>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_24d204e34d9015732709e1384165f894.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_24d204e34d9015732709e1384165f894.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a105d0>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c65490>
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F57%252F6d575e572a59ac642089913dffa310b0%252Fpa%252FCB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg saved to cache
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1013f2fe-7606-500e-9679-05298bbe372a
2026-03-30 12:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1013f2fe-7606-500e-9679-05298bbe372a, skipping ID generation
2026-03-30 12:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1013f2fe-7606-500e-9679-05298bbe372a with scrape type 1
2026-03-30 12:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1013f2fe-7606-500e-9679-05298bbe372a sending to next pipeline
2026-03-30 12:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1013f2fe-7606-500e-9679-05298bbe372a, identifier: CB26112
2026-03-30 12:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1013f2fe-7606-500e-9679-05298bbe372a with identifier: CB26112
2026-03-30 12:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1013f2fe-7606-500e-9679-05298bbe372a with identifier: CB26112
2026-03-30 12:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1013f2fe-7606-500e-9679-05298bbe372a with identifier: CB26112 to the API
2026-03-30 12:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:31:15Z',
'fuel_type': 'diesel',
'id': '1013f2fe-7606-500e-9679-05298bbe372a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB26112',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C4',
'odometer': 208763,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c8fde37157a769de79ce9ad4dcbb208d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_29084abc953d30c2aad2c36c4fb6f5bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_24d204e34d9015732709e1384165f894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_a7e1735b80c1bffe33720171d68a095d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_c2cabc6e2232a2250d9b11758dcc7cbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_f07adf0d4e5277230030eab73ba37c6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_b8cabc9f57e8da85c89d02bdd3be3c31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_0c4100a6c52ca985236ea52bbe46b445.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_2949b51f4ca10e05277cb6bde8f1d9a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1013f2fe-7606-500e-9679-05298bbe372a/1013f2fe-7606-500e-9679-05298bbe372a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/57/6d575e572a59ac642089913dffa310b0/pa/CB26112_5efa210fe38460e7dbc0f9b91bde6252.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2012}
2026-03-30 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB26112%27 HTTP/1.1" 200 None
2026-03-30 12:05:54 [auto1.fr] INFO: Saving data for CB26112: {'created_time': 1774872354.9902, 'last_price_update_time': 1774872354.990217, 'auction_closing_time': 1774971075.0}
2026-03-30 12:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB26112') HTTP/1.1" 204 0
2026-03-30 12:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS25944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT40530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW58466> (referer: https://www.auto1.com/v1/car-details-view/HW58466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-03-30 12:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e214c93-379a-532c-a820-0b2c03ca46b0 with scrape type 1
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_24bf6827745df31d2a96c6a66c1c848e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg not downloaded yet
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_8982ad8e1729bc339e162a364bc8c145.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg not downloaded yet
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg not downloaded yet
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_1022e716a7e40b37f7e897d37777f42d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg not downloaded yet
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_511718f607e675b046dae68112808f62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg not downloaded yet
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_70691db6ecad087326ef38bc902ebd8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg not downloaded yet
2026-03-30 12:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:05:58 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 5699 | hits on page: 40
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: WU09307
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU09307%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [auto1.fr] INFO: Scrape type for WU09307: 1
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: YS04060
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: NH60039
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: WV56090
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: NV07534
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: WX18382
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: LT10059
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: ZL96278
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: GS44106
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: DS47849
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: AB23264
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB23264%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [auto1.fr] INFO: Scrape type for AB23264: 1
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: SE79976
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: PM05502
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: XB70912
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: MT71985
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: WM28466
2026-03-30 12:05:58 [auto1.fr] INFO: Found listing with ID: PF67996
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF67996%27 HTTP/1.1" 200 None
2026-03-30 12:05:58 [auto1.fr] INFO: Scrape type for PF67996: 2
2026-03-30 12:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ff00226-391f-5e29-b9ef-790db4b0dc13 with identifier: PF67996
2026-03-30 12:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ff00226-391f-5e29-b9ef-790db4b0dc13 with scrape type 2
2026-03-30 12:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ff00226-391f-5e29-b9ef-790db4b0dc13 with scrape type 2
2026-03-30 12:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ff00226-391f-5e29-b9ef-790db4b0dc13, identifier: PF67996
2026-03-30 12:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ff00226-391f-5e29-b9ef-790db4b0dc13 with identifier: PF67996
2026-03-30 12:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ff00226-391f-5e29-b9ef-790db4b0dc13 with identifier: PF67996
2026-03-30 12:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ff00226-391f-5e29-b9ef-790db4b0dc13 with identifier: PF67996 to the API
2026-03-30 12:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:56:20Z',
'fuel_type': 'diesel',
'id': '3ff00226-391f-5e29-b9ef-790db4b0dc13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF67996',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 258015,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-30',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2016}
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF67996%27 HTTP/1.1" 200 None
2026-03-30 12:05:59 [auto1.fr] INFO: Saving data for PF67996: {'auction_closing_time': 1774972580.0, 'created_time': 1774267099.943987, 'last_price_update_time': 1774872359.274736}
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF67996') HTTP/1.1" 204 0
2026-03-30 12:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: DH19170
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: SY82143
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY82143%27 HTTP/1.1" 200 None
2026-03-30 12:05:59 [auto1.fr] INFO: Scrape type for SY82143: 1
2026-03-30 12:05:59 [scrapy.extensions.logstats] INFO: Crawled 126 pages (at 20 pages/min), scraped 126 items (at 16 items/min)
2026-03-30 12:05:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: PB24231
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB24231%27 HTTP/1.1" 200 None
2026-03-30 12:05:59 [auto1.fr] INFO: Scrape type for PB24231: 1
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: LZ43337
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: EC47257
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: FY82549
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: SF81175
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: YP51598
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: MS48505
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: LA37286
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: JA87898
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: BN65079
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: FS32024
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: JH20182
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: YR96034
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: CY69551
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: WM59560
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 12:05:59 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS87587%27 HTTP/1.1" 200 None
2026-03-30 12:05:59 [auto1.fr] INFO: Scrape type for GS87587: 1
2026-03-30 12:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b685d0>
2026-03-30 12:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_70691db6ecad087326ef38bc902ebd8d.jpg') HTTP/1.1" 204 0
2026-03-30 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg saved to cache
2026-03-30 12:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK45621> (referer: https://www.auto1.com/v1/car-details-view/PK45621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baf2bf62-ab52-5afa-a6ab-c88e6d3890b5 with identifier: PK45621
2026-03-30 12:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baf2bf62-ab52-5afa-a6ab-c88e6d3890b5 with scrape type 1
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item baf2bf62-ab52-5afa-a6ab-c88e6d3890b5
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_481d98d79471b31db7521ffdcd0a093d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_481d98d79471b31db7521ffdcd0a093d.jpg already downloaded
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_332870f4cdb9c70400a8b323297893aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_332870f4cdb9c70400a8b323297893aa.jpg already downloaded
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_798bf241ff20798e7143873b4afbd564.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_798bf241ff20798e7143873b4afbd564.jpg already downloaded
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_e36efa6af389dd980a8f9c4f07fbbe7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_e36efa6af389dd980a8f9c4f07fbbe7d.jpg already downloaded
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_9cc9b98f6051a726761738772e6cde1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_9cc9b98f6051a726761738772e6cde1d.jpg already downloaded
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ffa%252F45fa433b74fdb9b51699d6258e475ff5%252Fpa%252FPK45621_365f4af2c6e306bc05cd05162cdf0a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_365f4af2c6e306bc05cd05162cdf0a70.jpg already downloaded
2026-03-30 12:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: baf2bf62-ab52-5afa-a6ab-c88e6d3890b5, identifier: PK45621
2026-03-30 12:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: baf2bf62-ab52-5afa-a6ab-c88e6d3890b5 with identifier: PK45621
2026-03-30 12:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: baf2bf62-ab52-5afa-a6ab-c88e6d3890b5 with identifier: PK45621
2026-03-30 12:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: baf2bf62-ab52-5afa-a6ab-c88e6d3890b5 with identifier: PK45621 to the API
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK45621>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:35:22Z',
'fuel_type': 'diesel',
'id': 'baf2bf62-ab52-5afa-a6ab-c88e6d3890b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK45621',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Peugeot',
'model': '207',
'odometer': 134772,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_481d98d79471b31db7521ffdcd0a093d.jpg',
'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_332870f4cdb9c70400a8b323297893aa.jpg',
'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_798bf241ff20798e7143873b4afbd564.jpg',
'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_e36efa6af389dd980a8f9c4f07fbbe7d.jpg',
'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_9cc9b98f6051a726761738772e6cde1d.jpg',
'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_365f4af2c6e306bc05cd05162cdf0a70.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_481d98d79471b31db7521ffdcd0a093d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_332870f4cdb9c70400a8b323297893aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_798bf241ff20798e7143873b4afbd564.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_e36efa6af389dd980a8f9c4f07fbbe7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_9cc9b98f6051a726761738772e6cde1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baf2bf62-ab52-5afa-a6ab-c88e6d3890b5/baf2bf62-ab52-5afa-a6ab-c88e6d3890b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/fa/45fa433b74fdb9b51699d6258e475ff5/pa/PK45621_365f4af2c6e306bc05cd05162cdf0a70.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2010}
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK45621%27 HTTP/1.1" 200 None
2026-03-30 12:06:04 [auto1.fr] INFO: Saving data for PK45621: {'created_time': 1774872364.581712, 'last_price_update_time': 1774872364.581723, 'auction_closing_time': 1774971322.0}
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK45621') HTTP/1.1" 204 0
2026-03-30 12:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB67890> (referer: https://www.auto1.com/v1/car-details-view/HB67890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff94bd8e-0536-5b64-951f-453b2d41d2d7 with identifier: HB67890
2026-03-30 12:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff94bd8e-0536-5b64-951f-453b2d41d2d7 with scrape type 1
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ff94bd8e-0536-5b64-951f-453b2d41d2d7
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_6df0ba60c7ec85805349953bcc7f11ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6df0ba60c7ec85805349953bcc7f11ea.jpg already downloaded
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_c8acd210b96233602111b658fb128f0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_c8acd210b96233602111b658fb128f0e.jpg already downloaded
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_6f54e05d0f826c94500f2ddb5d0e8017.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6f54e05d0f826c94500f2ddb5d0e8017.jpg already downloaded
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_ea05f8909f669f66c1bc97a15b745674.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_ea05f8909f669f66c1bc97a15b745674.jpg already downloaded
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_fb77ade5967b113fcc386925138f9f9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_fb77ade5967b113fcc386925138f9f9c.jpg already downloaded
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdb%252F09db20eb19637d9f7d3800f5f44a0ff6%252Fpa%252FHB67890_853d568ac7c02860a51f587d2b597056.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_853d568ac7c02860a51f587d2b597056.jpg already downloaded
2026-03-30 12:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff94bd8e-0536-5b64-951f-453b2d41d2d7, identifier: HB67890
2026-03-30 12:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff94bd8e-0536-5b64-951f-453b2d41d2d7 with identifier: HB67890
2026-03-30 12:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff94bd8e-0536-5b64-951f-453b2d41d2d7 with identifier: HB67890
2026-03-30 12:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff94bd8e-0536-5b64-951f-453b2d41d2d7 with identifier: HB67890 to the API
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB67890>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:21:17Z',
'fuel_type': 'diesel',
'id': 'ff94bd8e-0536-5b64-951f-453b2d41d2d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB67890',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Renault',
'model': 'Scenic',
'odometer': 194060,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6df0ba60c7ec85805349953bcc7f11ea.jpg',
'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_c8acd210b96233602111b658fb128f0e.jpg',
'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6f54e05d0f826c94500f2ddb5d0e8017.jpg',
'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_ea05f8909f669f66c1bc97a15b745674.jpg',
'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_fb77ade5967b113fcc386925138f9f9c.jpg',
'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_853d568ac7c02860a51f587d2b597056.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6df0ba60c7ec85805349953bcc7f11ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_c8acd210b96233602111b658fb128f0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_6f54e05d0f826c94500f2ddb5d0e8017.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_ea05f8909f669f66c1bc97a15b745674.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_fb77ade5967b113fcc386925138f9f9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff94bd8e-0536-5b64-951f-453b2d41d2d7/ff94bd8e-0536-5b64-951f-453b2d41d2d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/db/09db20eb19637d9f7d3800f5f44a0ff6/pa/HB67890_853d568ac7c02860a51f587d2b597056.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.6 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2013}
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB67890%27 HTTP/1.1" 200 None
2026-03-30 12:06:08 [auto1.fr] INFO: Saving data for HB67890: {'created_time': 1774872368.708385, 'last_price_update_time': 1774872368.7084, 'auction_closing_time': 1774970477.0}
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HB67890') HTTP/1.1" 204 0
2026-03-30 12:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL33581> (referer: https://www.auto1.com/v1/car-details-view/UL33581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d063700c-611a-5fe1-be5a-2f7ac8074850 with identifier: UL33581
2026-03-30 12:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d063700c-611a-5fe1-be5a-2f7ac8074850 with scrape type 1
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_31c601fec3b85ae191b10262d8c6d92b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_31c601fec3b85ae191b10262d8c6d92b.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_95b580a872b36793729b53a436a80fc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_95b580a872b36793729b53a436a80fc1.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_cd8563d68bab4e56d895c123e8c075ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_cd8563d68bab4e56d895c123e8c075ac.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_c1d6761b16d2cbfc397d6d981165737f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_c1d6761b16d2cbfc397d6d981165737f.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_79682aeabf96b22bd55deab602370320.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_79682aeabf96b22bd55deab602370320.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_4d38500454d6afaf7c41e725ea669484.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_4d38500454d6afaf7c41e725ea669484.jpg not downloaded yet
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg not downloaded yet
2026-03-30 12:06:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.984(s), this was the 1st time calling it.
2026-03-30 12:06:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.411623610126577 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:06:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.989(s), this was the 1st time calling it.
2026-03-30 12:06:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.111721099620686 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG17064> (referer: https://www.auto1.com/v1/car-details-view/RG17064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f894ca3a-ae54-58a2-a581-a2f1f52f7352 with identifier: RG17064
2026-03-30 12:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f894ca3a-ae54-58a2-a581-a2f1f52f7352 with scrape type 1
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f894ca3a-ae54-58a2-a581-a2f1f52f7352
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_ccd0027e4f5002d8a47c645c49038e7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_ccd0027e4f5002d8a47c645c49038e7c.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_786bfa6d53b372583619620a1a695336.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_786bfa6d53b372583619620a1a695336.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_a68941a630c9097b57db393d926ebe1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a68941a630c9097b57db393d926ebe1b.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_18653fab038a2c792fd75f095216c500.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_18653fab038a2c792fd75f095216c500.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_fa54119c17e1cc1233a699a929a7d412.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_fa54119c17e1cc1233a699a929a7d412.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_a870d9016f2b537afd3f37b0673a5cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a870d9016f2b537afd3f37b0673a5cac.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_0fb8d93ab771e3edae3d6384a80cabef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_0fb8d93ab771e3edae3d6384a80cabef.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_7392400fe4601e620114d349cac0c72c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_7392400fe4601e620114d349cac0c72c.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_da158fa0a0bb031ac4ec1ca9c7a7bbe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_da158fa0a0bb031ac4ec1ca9c7a7bbe0.jpg already downloaded
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb0%252F88b0482992e66453506ca1c198e26215%252Fpa%252FRG17064_1be4349bf119b00729eb70ea7c8cf79e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_1be4349bf119b00729eb70ea7c8cf79e.jpg already downloaded
2026-03-30 12:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f894ca3a-ae54-58a2-a581-a2f1f52f7352, identifier: RG17064
2026-03-30 12:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f894ca3a-ae54-58a2-a581-a2f1f52f7352 with identifier: RG17064
2026-03-30 12:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f894ca3a-ae54-58a2-a581-a2f1f52f7352 with identifier: RG17064
2026-03-30 12:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f894ca3a-ae54-58a2-a581-a2f1f52f7352 with identifier: RG17064 to the API
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG17064>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:47:30Z',
'fuel_type': 'petrol',
'id': 'f894ca3a-ae54-58a2-a581-a2f1f52f7352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG17064',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '208',
'odometer': 54561,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_ccd0027e4f5002d8a47c645c49038e7c.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_786bfa6d53b372583619620a1a695336.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a68941a630c9097b57db393d926ebe1b.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_18653fab038a2c792fd75f095216c500.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_fa54119c17e1cc1233a699a929a7d412.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a870d9016f2b537afd3f37b0673a5cac.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_0fb8d93ab771e3edae3d6384a80cabef.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_7392400fe4601e620114d349cac0c72c.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_da158fa0a0bb031ac4ec1ca9c7a7bbe0.jpg',
'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_1be4349bf119b00729eb70ea7c8cf79e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2696910,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_ccd0027e4f5002d8a47c645c49038e7c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_786bfa6d53b372583619620a1a695336.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a68941a630c9097b57db393d926ebe1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_18653fab038a2c792fd75f095216c500.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_fa54119c17e1cc1233a699a929a7d412.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2307489,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_a870d9016f2b537afd3f37b0673a5cac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_0fb8d93ab771e3edae3d6384a80cabef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_7392400fe4601e620114d349cac0c72c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2704113,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_da158fa0a0bb031ac4ec1ca9c7a7bbe0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f894ca3a-ae54-58a2-a581-a2f1f52f7352/f894ca3a-ae54-58a2-a581-a2f1f52f7352_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2842440,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img88/b0/88b0482992e66453506ca1c198e26215/pa/RG17064_1be4349bf119b00729eb70ea7c8cf79e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG17064%27 HTTP/1.1" 200 None
2026-03-30 12:06:23 [auto1.fr] INFO: Saving data for RG17064: {'created_time': 1774872383.906094, 'last_price_update_time': 1774872383.906108, 'auction_closing_time': 1774972050.0}
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG17064') HTTP/1.1" 204 0
2026-03-30 12:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1cf10>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_4d38500454d6afaf7c41e725ea669484.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aac490>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_4d38500454d6afaf7c41e725ea669484.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_4d38500454d6afaf7c41e725ea669484.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aad550>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_79682aeabf96b22bd55deab602370320.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6a090>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_79682aeabf96b22bd55deab602370320.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_79682aeabf96b22bd55deab602370320.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_c1d6761b16d2cbfc397d6d981165737f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a9910>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_c1d6761b16d2cbfc397d6d981165737f.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_c1d6761b16d2cbfc397d6d981165737f.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_cd8563d68bab4e56d895c123e8c075ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c0d310>
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_cd8563d68bab4e56d895c123e8c075ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_cd8563d68bab4e56d895c123e8c075ac.jpg saved to cache
2026-03-30 12:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514f010>
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg saved to cache
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_95b580a872b36793729b53a436a80fc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508e010>
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_95b580a872b36793729b53a436a80fc1.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_95b580a872b36793729b53a436a80fc1.jpg saved to cache
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_31c601fec3b85ae191b10262d8c6d92b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285159c50>
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg saved to cache
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850e9d10>
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F86%252Ff786098a7e553f6240a8ce20d7f288db%252Fpa%252FUL33581_31c601fec3b85ae191b10262d8c6d92b.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_31c601fec3b85ae191b10262d8c6d92b.jpg saved to cache
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d063700c-611a-5fe1-be5a-2f7ac8074850
2026-03-30 12:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d063700c-611a-5fe1-be5a-2f7ac8074850, skipping ID generation
2026-03-30 12:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d063700c-611a-5fe1-be5a-2f7ac8074850 with scrape type 1
2026-03-30 12:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d063700c-611a-5fe1-be5a-2f7ac8074850 sending to next pipeline
2026-03-30 12:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d063700c-611a-5fe1-be5a-2f7ac8074850, identifier: UL33581
2026-03-30 12:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d063700c-611a-5fe1-be5a-2f7ac8074850 with identifier: UL33581
2026-03-30 12:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d063700c-611a-5fe1-be5a-2f7ac8074850 with identifier: UL33581
2026-03-30 12:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d063700c-611a-5fe1-be5a-2f7ac8074850 with identifier: UL33581 to the API
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_31c601fec3b85ae191b10262d8c6d92b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:06:57Z',
'fuel_type': 'diesel',
'id': 'd063700c-611a-5fe1-be5a-2f7ac8074850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL33581',
'listing': 'auction',
'location': 'FR, Villefranche-sur-Saône',
'make': 'BMW',
'model': '1er',
'odometer': 170964,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_31c601fec3b85ae191b10262d8c6d92b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_425cf7be4839ffdf3eed93b849ea5c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_95b580a872b36793729b53a436a80fc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_2555a23a2b9da9cceb0615e19c7052d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_cd8563d68bab4e56d895c123e8c075ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_c1d6761b16d2cbfc397d6d981165737f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_79682aeabf96b22bd55deab602370320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_a9d23b4344b8dd5146ec2639cff6dade.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_4d38500454d6afaf7c41e725ea669484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d063700c-611a-5fe1-be5a-2f7ac8074850/d063700c-611a-5fe1-be5a-2f7ac8074850_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/86/f786098a7e553f6240a8ce20d7f288db/pa/UL33581_b1b108debe8d0ff9990173f9ef52cdf2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d Premiere',
'transmission': 'automatic',
'trim': 'Premiere',
'year': 2010}
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL33581%27 HTTP/1.1" 200 None
2026-03-30 12:06:25 [auto1.fr] INFO: Saving data for UL33581: {'created_time': 1774872385.947794, 'last_price_update_time': 1774872385.947807, 'auction_closing_time': 1774969617.0}
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL33581') HTTP/1.1" 204 0
2026-03-30 12:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX76381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM86570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS25944> (referer: https://www.auto1.com/v1/car-details-view/PS25944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56 with identifier: PS25944
2026-03-30 12:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56 with scrape type 1
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_cdb25df2981216778806d28f3132c03b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_cdb25df2981216778806d28f3132c03b.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_b90bb3e616c594d04496aed2d5722038.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_b90bb3e616c594d04496aed2d5722038.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_21df298a4ed49cf28512f340d3fe57f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_21df298a4ed49cf28512f340d3fe57f3.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_a4a24ed2f40b74dcab4e91de6da47bbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a4a24ed2f40b74dcab4e91de6da47bbd.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_5c71527af14efc31b570a16d9f41719f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_5c71527af14efc31b570a16d9f41719f.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_226e5ea20df0e864e1203b0edaf71d03.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_226e5ea20df0e864e1203b0edaf71d03.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_bde26b86235dc42853d3118c6fa6cb15.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_bde26b86235dc42853d3118c6fa6cb15.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_57dfd5658011666d18ecfc1b06b8f5f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_57dfd5658011666d18ecfc1b06b8f5f0.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_a993ed925deb94ac98ba793fc5092513.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a993ed925deb94ac98ba793fc5092513.jpg already downloaded
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F2f%252F412f461d5c6f1dc30100902c5b0155ce%252Fpa%252FPS25944_63a821a9f53156814d03bd996996cdb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_63a821a9f53156814d03bd996996cdb6.jpg already downloaded
2026-03-30 12:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56, identifier: PS25944
2026-03-30 12:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56 with identifier: PS25944
2026-03-30 12:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56 with identifier: PS25944
2026-03-30 12:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56 with identifier: PS25944 to the API
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS25944>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:49:51Z',
'fuel_type': 'diesel',
'id': 'c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS25944',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Opel',
'model': 'Mokka',
'odometer': 150822,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_cdb25df2981216778806d28f3132c03b.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_b90bb3e616c594d04496aed2d5722038.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_21df298a4ed49cf28512f340d3fe57f3.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a4a24ed2f40b74dcab4e91de6da47bbd.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_5c71527af14efc31b570a16d9f41719f.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_226e5ea20df0e864e1203b0edaf71d03.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_bde26b86235dc42853d3118c6fa6cb15.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_57dfd5658011666d18ecfc1b06b8f5f0.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a993ed925deb94ac98ba793fc5092513.jpg',
'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_63a821a9f53156814d03bd996996cdb6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_cdb25df2981216778806d28f3132c03b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3084747,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_b90bb3e616c594d04496aed2d5722038.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_21df298a4ed49cf28512f340d3fe57f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a4a24ed2f40b74dcab4e91de6da47bbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_5c71527af14efc31b570a16d9f41719f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_226e5ea20df0e864e1203b0edaf71d03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3028412,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_bde26b86235dc42853d3118c6fa6cb15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3404162,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_57dfd5658011666d18ecfc1b06b8f5f0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_a993ed925deb94ac98ba793fc5092513.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56/c3b7c47e-5c9a-5b05-b7a4-7659e14c1a56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/2f/412f461d5c6f1dc30100902c5b0155ce/pa/PS25944_63a821a9f53156814d03bd996996cdb6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2015}
2026-03-30 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS25944%27 HTTP/1.1" 200 None
2026-03-30 12:06:32 [auto1.fr] INFO: Saving data for PS25944: {'created_time': 1774872392.012181, 'last_price_update_time': 1774872392.012193, 'auction_closing_time': 1774972191.0}
2026-03-30 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS25944') HTTP/1.1" 204 0
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB66153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285155ed0>
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_511718f607e675b046dae68112808f62.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg saved to cache
2026-03-30 12:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT40530> (referer: https://www.auto1.com/v1/car-details-view/ZT40530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb88fbd9-b8b4-50e0-8ea1-482a37377fd6 with identifier: ZT40530
2026-03-30 12:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb88fbd9-b8b4-50e0-8ea1-482a37377fd6 with scrape type 1
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fb88fbd9-b8b4-50e0-8ea1-482a37377fd6
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_1fd8b8b66084bd52025df72190de525d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_1fd8b8b66084bd52025df72190de525d.jpg already downloaded
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_ecec18433ca6cb907f25adc35b2d9bd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_ecec18433ca6cb907f25adc35b2d9bd3.jpg already downloaded
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_21871c3dd35871d2c6690b508c920e14.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_21871c3dd35871d2c6690b508c920e14.jpg already downloaded
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_12a0d303847506fbf60c96ba0b1a8b67.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_12a0d303847506fbf60c96ba0b1a8b67.jpg already downloaded
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_4370b20f0be57d647c78038a542f42dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_4370b20f0be57d647c78038a542f42dc.jpg already downloaded
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F01%252Fb301ad6168e26d5acd08aaf6f33ed13e%252Fpa%252FZT40530_c8b26e11a97f6b7e63cd92c4e6d698ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_c8b26e11a97f6b7e63cd92c4e6d698ed.jpg already downloaded
2026-03-30 12:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb88fbd9-b8b4-50e0-8ea1-482a37377fd6, identifier: ZT40530
2026-03-30 12:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb88fbd9-b8b4-50e0-8ea1-482a37377fd6 with identifier: ZT40530
2026-03-30 12:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb88fbd9-b8b4-50e0-8ea1-482a37377fd6 with identifier: ZT40530
2026-03-30 12:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb88fbd9-b8b4-50e0-8ea1-482a37377fd6 with identifier: ZT40530 to the API
2026-03-30 12:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZT40530>
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:36:47Z',
'fuel_type': 'diesel',
'id': 'fb88fbd9-b8b4-50e0-8ea1-482a37377fd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT40530',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 330480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_1fd8b8b66084bd52025df72190de525d.jpg',
'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_ecec18433ca6cb907f25adc35b2d9bd3.jpg',
'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_21871c3dd35871d2c6690b508c920e14.jpg',
'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_12a0d303847506fbf60c96ba0b1a8b67.jpg',
'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_4370b20f0be57d647c78038a542f42dc.jpg',
'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_c8b26e11a97f6b7e63cd92c4e6d698ed.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_1fd8b8b66084bd52025df72190de525d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_ecec18433ca6cb907f25adc35b2d9bd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_21871c3dd35871d2c6690b508c920e14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_12a0d303847506fbf60c96ba0b1a8b67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_4370b20f0be57d647c78038a542f42dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb88fbd9-b8b4-50e0-8ea1-482a37377fd6/fb88fbd9-b8b4-50e0-8ea1-482a37377fd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b301ad6168e26d5acd08aaf6f33ed13e/pa/ZT40530_c8b26e11a97f6b7e63cd92c4e6d698ed.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2010}
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT40530%27 HTTP/1.1" 200 None
2026-03-30 12:06:48 [auto1.fr] INFO: Saving data for ZT40530: {'created_time': 1774872408.442264, 'last_price_update_time': 1774872408.442278, 'auction_closing_time': 1774971407.0}
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZT40530') HTTP/1.1" 204 0
2026-03-30 12:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0f310>
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_1022e716a7e40b37f7e897d37777f42d.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg saved to cache
2026-03-30 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a9a850>
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg saved to cache
2026-03-30 12:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513f590>
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_8982ad8e1729bc339e162a364bc8c145.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg saved to cache
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dc4d0>
2026-03-30 12:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F07%252F830762d90e8044f9b5ea410472ef52fd%252Fpa%252FHW58466_24bf6827745df31d2a96c6a66c1c848e.jpg') HTTP/1.1" 204 0
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg saved to cache
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e214c93-379a-532c-a820-0b2c03ca46b0
2026-03-30 12:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e214c93-379a-532c-a820-0b2c03ca46b0, skipping ID generation
2026-03-30 12:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e214c93-379a-532c-a820-0b2c03ca46b0 with scrape type 1
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e214c93-379a-532c-a820-0b2c03ca46b0 sending to next pipeline
2026-03-30 12:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e214c93-379a-532c-a820-0b2c03ca46b0, identifier: HW58466
2026-03-30 12:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-03-30 12:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466
2026-03-30 12:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e214c93-379a-532c-a820-0b2c03ca46b0 with identifier: HW58466 to the API
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:52:19Z',
'fuel_type': 'diesel',
'id': '4e214c93-379a-532c-a820-0b2c03ca46b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW58466',
'listing': 'auction',
'location': 'FR, Manosque',
'make': 'Fiat',
'model': 'Punto',
'odometer': 195415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_24bf6827745df31d2a96c6a66c1c848e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_8982ad8e1729bc339e162a364bc8c145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_836d4f6a8a601a5a4d3dbe4908454e73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_1022e716a7e40b37f7e897d37777f42d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_511718f607e675b046dae68112808f62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e214c93-379a-532c-a820-0b2c03ca46b0/4e214c93-379a-532c-a820-0b2c03ca46b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/07/830762d90e8044f9b5ea410472ef52fd/pa/HW58466_70691db6ecad087326ef38bc902ebd8d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-07',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.3 JTD Classic Active',
'transmission': 'manual',
'trim': 'Classic Active',
'year': 2011}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW58466%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [auto1.fr] INFO: Saving data for HW58466: {'created_time': 1774872409.586978, 'last_price_update_time': 1774872409.586992, 'auction_closing_time': 1774972339.0}
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW58466') HTTP/1.1" 204 0
2026-03-30 12:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS87587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ56580> (referer: https://www.auto1.com/v1/car-details-view/EJ56580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 468429b4-1987-5651-85e1-f74937676e3b with identifier: EJ56580
2026-03-30 12:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 468429b4-1987-5651-85e1-f74937676e3b with scrape type 1
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 468429b4-1987-5651-85e1-f74937676e3b
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_c28d5aad00a6fab7d42fa8fb02bb7df4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_c28d5aad00a6fab7d42fa8fb02bb7df4.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_4364ce65ed0182f9fd2b27400cd099d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_4364ce65ed0182f9fd2b27400cd099d8.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_311589e386fd3a7afc064e0c17a29b11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_311589e386fd3a7afc064e0c17a29b11.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_83e85d85048c9a68a520944cca841ffb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_83e85d85048c9a68a520944cca841ffb.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_48a42127eb8d4b78670803d6071df75d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_48a42127eb8d4b78670803d6071df75d.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_6dccf08b192512e0e574515057406857.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_6dccf08b192512e0e574515057406857.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_0b1ed8cda984c10a2b6e04920e4085fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_0b1ed8cda984c10a2b6e04920e4085fc.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_420645834cd932b8b033b7843a34d585.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_420645834cd932b8b033b7843a34d585.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_d8f6cda804c81d1124fc35082b8a12b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_d8f6cda804c81d1124fc35082b8a12b8.jpg already downloaded
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fd3%252F6dd353a8585372ee3bd84b3577329cc1%252Fpa%252FEJ56580_45112932553eedeb77e0eb6045e791b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_45112932553eedeb77e0eb6045e791b4.jpg already downloaded
2026-03-30 12:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 468429b4-1987-5651-85e1-f74937676e3b, identifier: EJ56580
2026-03-30 12:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 468429b4-1987-5651-85e1-f74937676e3b with identifier: EJ56580
2026-03-30 12:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 468429b4-1987-5651-85e1-f74937676e3b with identifier: EJ56580
2026-03-30 12:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 468429b4-1987-5651-85e1-f74937676e3b with identifier: EJ56580 to the API
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ56580>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:28:21Z',
'fuel_type': 'diesel',
'id': '468429b4-1987-5651-85e1-f74937676e3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ56580',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Audi',
'model': 'Q5',
'odometer': 180972,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_c28d5aad00a6fab7d42fa8fb02bb7df4.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_4364ce65ed0182f9fd2b27400cd099d8.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_311589e386fd3a7afc064e0c17a29b11.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_83e85d85048c9a68a520944cca841ffb.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_48a42127eb8d4b78670803d6071df75d.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_6dccf08b192512e0e574515057406857.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_0b1ed8cda984c10a2b6e04920e4085fc.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_420645834cd932b8b033b7843a34d585.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_d8f6cda804c81d1124fc35082b8a12b8.jpg',
'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_45112932553eedeb77e0eb6045e791b4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_c28d5aad00a6fab7d42fa8fb02bb7df4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_4364ce65ed0182f9fd2b27400cd099d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_311589e386fd3a7afc064e0c17a29b11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_83e85d85048c9a68a520944cca841ffb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_48a42127eb8d4b78670803d6071df75d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_6dccf08b192512e0e574515057406857.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_0b1ed8cda984c10a2b6e04920e4085fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_420645834cd932b8b033b7843a34d585.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_d8f6cda804c81d1124fc35082b8a12b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_468429b4-1987-5651-85e1-f74937676e3b/468429b4-1987-5651-85e1-f74937676e3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/d3/6dd353a8585372ee3bd84b3577329cc1/pa/EJ56580_45112932553eedeb77e0eb6045e791b4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Ambition Luxe',
'transmission': 'automatic',
'trim': 'quattro Ambition Luxe',
'year': 2013}
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ56580%27 HTTP/1.1" 200 None
2026-03-30 12:06:50 [auto1.fr] INFO: Saving data for EJ56580: {'created_time': 1774872410.357844, 'last_price_update_time': 1774872410.357854, 'auction_closing_time': 1774970901.0}
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ56580') HTTP/1.1" 204 0
2026-03-30 12:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR75409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:58 [scrapy.extensions.logstats] INFO: Crawled 137 pages (at 11 pages/min), scraped 134 items (at 8 items/min)
2026-03-30 12:06:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU09307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:00 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 5701 | hits on page: 40
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: SC94219
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: NL15141
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: YL76832
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: DW24154
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: TS11881
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: KL52041
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: DE92084
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: FN42145
2026-03-30 12:07:00 [auto1.fr] INFO: Found listing with ID: PF51993
2026-03-30 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF51993%27 HTTP/1.1" 200 None
2026-03-30 12:07:01 [auto1.fr] INFO: Scrape type for PF51993: 2
2026-03-30 12:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9425c0b6-82ab-575e-94cf-fa176205b508 with identifier: PF51993
2026-03-30 12:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9425c0b6-82ab-575e-94cf-fa176205b508 with scrape type 2
2026-03-30 12:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9425c0b6-82ab-575e-94cf-fa176205b508 with scrape type 2
2026-03-30 12:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9425c0b6-82ab-575e-94cf-fa176205b508, identifier: PF51993
2026-03-30 12:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9425c0b6-82ab-575e-94cf-fa176205b508 with identifier: PF51993
2026-03-30 12:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9425c0b6-82ab-575e-94cf-fa176205b508 with identifier: PF51993
2026-03-30 12:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9425c0b6-82ab-575e-94cf-fa176205b508 with identifier: PF51993 to the API
2026-03-30 12:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:53:08Z',
'fuel_type': 'petrol',
'id': '9425c0b6-82ab-575e-94cf-fa176205b508',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF51993',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 110903,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-25',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Roland Garros',
'transmission': 'manual',
'trim': 'Roland Garros',
'year': 2018}
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF51993%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [auto1.fr] INFO: Saving data for PF51993: {'auction_closing_time': 1774972388.0, 'created_time': 1774253457.73749, 'last_price_update_time': 1774872424.759692}
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF51993') HTTP/1.1" 204 0
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: RP02187
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: YW96620
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: YB41895
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: SP91950
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP91950%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [auto1.fr] INFO: Scrape type for SP91950: 1
2026-03-30 12:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH75787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: KF87989
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: MD52514
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: KA23831
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: ES52369
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: NL28829
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: FS23281
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: YN72247
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: NP71394
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: KV16401
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV16401%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [auto1.fr] INFO: Scrape type for KV16401: 1
2026-03-30 12:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: JN91782
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: GP12773
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: CH14191
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: LH28225
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH28225%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [auto1.fr] INFO: Scrape type for LH28225: 1
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: PW51275
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: YB91559
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB91559%27 HTTP/1.1" 200 None
2026-03-30 12:07:04 [auto1.fr] INFO: Scrape type for YB91559: 1
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: GE60554
2026-03-30 12:07:04 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 12:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX76381> (referer: https://www.auto1.com/v1/car-details-view/VX76381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f61793-4577-56d3-b71f-499ab6ccf239 with identifier: VX76381
2026-03-30 12:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f61793-4577-56d3-b71f-499ab6ccf239 with scrape type 1
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_dd0a193ed5c21480c2b3e673229285d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_dd0a193ed5c21480c2b3e673229285d9.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_d9ea48f453a97d34d1953add3867fa86.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_d9ea48f453a97d34d1953add3867fa86.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_245a7afeac4c78c61994b371dccce535.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_245a7afeac4c78c61994b371dccce535.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_2289d71f49de680f85fdd913b9b04739.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_2289d71f49de680f85fdd913b9b04739.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_ae35e2fc8ea15935a8881274a94464b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_ae35e2fc8ea15935a8881274a94464b5.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_0da02e5cc13fb90211c498edf24b244f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0da02e5cc13fb90211c498edf24b244f.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_0f0986fe7005f94685763ad80d12497d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0f0986fe7005f94685763ad80d12497d.jpg not downloaded yet
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg not downloaded yet
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM86570> (referer: https://www.auto1.com/v1/car-details-view/BM86570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde0638b-1ba8-5a69-8eb3-51f87c564088 with identifier: BM86570
2026-03-30 12:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde0638b-1ba8-5a69-8eb3-51f87c564088 with scrape type 1
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_45b7b05c85232516d6ed4044073ac23a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_45b7b05c85232516d6ed4044073ac23a.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_1e114aff567d36af83fbf72e98a2f329.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_1e114aff567d36af83fbf72e98a2f329.jpg not downloaded yet
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_5f335322f8baa0f13375ed9d31be33f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_5f335322f8baa0f13375ed9d31be33f9.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_2479eb53a456c60f263230470faac56c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_2479eb53a456c60f263230470faac56c.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_30c8b394e0769abefd79dda501093bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_30c8b394e0769abefd79dda501093bff.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_e90760ffacc031777700a42d7ff42a50.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_e90760ffacc031777700a42d7ff42a50.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_558dc1a110d88f86d9032a1638092df0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_558dc1a110d88f86d9032a1638092df0.jpg not downloaded yet
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_45b7b05c85232516d6ed4044073ac23a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a87d0>
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg saved to cache
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_9273621e967a9112f15d0889847ff35c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9273621e967a9112f15d0889847ff35c.jpg not downloaded yet
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg not downloaded yet
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6bb50>
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_45b7b05c85232516d6ed4044073ac23a.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_45b7b05c85232516d6ed4044073ac23a.jpg saved to cache
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_e90760ffacc031777700a42d7ff42a50.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850e9710>
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_e90760ffacc031777700a42d7ff42a50.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_e90760ffacc031777700a42d7ff42a50.jpg saved to cache
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879d0d10>
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg saved to cache
2026-03-30 12:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9273621e967a9112f15d0889847ff35c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285102310>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_9273621e967a9112f15d0889847ff35c.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9273621e967a9112f15d0889847ff35c.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_558dc1a110d88f86d9032a1638092df0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a27c50>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_558dc1a110d88f86d9032a1638092df0.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_558dc1a110d88f86d9032a1638092df0.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_30c8b394e0769abefd79dda501093bff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6ae10>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_30c8b394e0769abefd79dda501093bff.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_30c8b394e0769abefd79dda501093bff.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_2479eb53a456c60f263230470faac56c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a7190>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_2479eb53a456c60f263230470faac56c.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_2479eb53a456c60f263230470faac56c.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_5f335322f8baa0f13375ed9d31be33f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72868d0050>
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_5f335322f8baa0f13375ed9d31be33f9.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_5f335322f8baa0f13375ed9d31be33f9.jpg saved to cache
2026-03-30 12:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY00599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514da50>
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg saved to cache
2026-03-30 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_1e114aff567d36af83fbf72e98a2f329.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0f0986fe7005f94685763ad80d12497d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bff990>
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F0c%252Fb20ce7aaef0e57d9eb4830cff803a467%252Fpa%252FBM86570_1e114aff567d36af83fbf72e98a2f329.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_1e114aff567d36af83fbf72e98a2f329.jpg saved to cache
2026-03-30 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dde0638b-1ba8-5a69-8eb3-51f87c564088
2026-03-30 12:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dde0638b-1ba8-5a69-8eb3-51f87c564088, skipping ID generation
2026-03-30 12:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde0638b-1ba8-5a69-8eb3-51f87c564088 with scrape type 1
2026-03-30 12:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dde0638b-1ba8-5a69-8eb3-51f87c564088 sending to next pipeline
2026-03-30 12:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dde0638b-1ba8-5a69-8eb3-51f87c564088, identifier: BM86570
2026-03-30 12:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dde0638b-1ba8-5a69-8eb3-51f87c564088 with identifier: BM86570
2026-03-30 12:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dde0638b-1ba8-5a69-8eb3-51f87c564088 with identifier: BM86570
2026-03-30 12:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dde0638b-1ba8-5a69-8eb3-51f87c564088 with identifier: BM86570 to the API
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_1e114aff567d36af83fbf72e98a2f329.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:29:23Z',
'fuel_type': 'diesel',
'id': 'dde0638b-1ba8-5a69-8eb3-51f87c564088',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM86570',
'listing': 'auction',
'location': 'FR',
'make': 'Seat',
'model': 'Altea XL',
'odometer': 207662,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_45b7b05c85232516d6ed4044073ac23a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_1e114aff567d36af83fbf72e98a2f329.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9ea2a33ee0f0b104319d6cdec62d1324.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_5f335322f8baa0f13375ed9d31be33f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_2479eb53a456c60f263230470faac56c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_30c8b394e0769abefd79dda501093bff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_e90760ffacc031777700a42d7ff42a50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_558dc1a110d88f86d9032a1638092df0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_9273621e967a9112f15d0889847ff35c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dde0638b-1ba8-5a69-8eb3-51f87c564088/dde0638b-1ba8-5a69-8eb3-51f87c564088_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/0c/b20ce7aaef0e57d9eb4830cff803a467/pa/BM86570_75a6e0c108a48e7a3793c5c9a1cf9cd5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Altea XL 1.9 TDI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2009}
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM86570%27 HTTP/1.1" 200 None
2026-03-30 12:07:09 [auto1.fr] INFO: Saving data for BM86570: {'created_time': 1774872429.959602, 'last_price_update_time': 1774872429.959617, 'auction_closing_time': 1774970963.0}
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM86570') HTTP/1.1" 204 0
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aad310>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_0f0986fe7005f94685763ad80d12497d.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0f0986fe7005f94685763ad80d12497d.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1dfd0>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0da02e5cc13fb90211c498edf24b244f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a10d50>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_0da02e5cc13fb90211c498edf24b244f.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0da02e5cc13fb90211c498edf24b244f.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b5390>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_ae35e2fc8ea15935a8881274a94464b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a4d090>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_ae35e2fc8ea15935a8881274a94464b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_ae35e2fc8ea15935a8881274a94464b5.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_2289d71f49de680f85fdd913b9b04739.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG22650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0f9d0>
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_2289d71f49de680f85fdd913b9b04739.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_2289d71f49de680f85fdd913b9b04739.jpg saved to cache
2026-03-30 12:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_245a7afeac4c78c61994b371dccce535.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_dd0a193ed5c21480c2b3e673229285d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_d9ea48f453a97d34d1953add3867fa86.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfdd90>
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_245a7afeac4c78c61994b371dccce535.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_245a7afeac4c78c61994b371dccce535.jpg saved to cache
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a5bf90>
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_dd0a193ed5c21480c2b3e673229285d9.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_dd0a193ed5c21480c2b3e673229285d9.jpg saved to cache
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b7750>
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fc7%252F85c7a84de6e6ef2a9b7feb3c68fe7f41%252Fpa%252FVX76381_d9ea48f453a97d34d1953add3867fa86.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_d9ea48f453a97d34d1953add3867fa86.jpg saved to cache
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f61793-4577-56d3-b71f-499ab6ccf239
2026-03-30 12:07:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f61793-4577-56d3-b71f-499ab6ccf239, skipping ID generation
2026-03-30 12:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f61793-4577-56d3-b71f-499ab6ccf239 with scrape type 1
2026-03-30 12:07:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f61793-4577-56d3-b71f-499ab6ccf239 sending to next pipeline
2026-03-30 12:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8f61793-4577-56d3-b71f-499ab6ccf239, identifier: VX76381
2026-03-30 12:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8f61793-4577-56d3-b71f-499ab6ccf239 with identifier: VX76381
2026-03-30 12:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8f61793-4577-56d3-b71f-499ab6ccf239 with identifier: VX76381
2026-03-30 12:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8f61793-4577-56d3-b71f-499ab6ccf239 with identifier: VX76381 to the API
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_d9ea48f453a97d34d1953add3867fa86.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:19Z',
'fuel_type': 'petrol',
'id': 'e8f61793-4577-56d3-b71f-499ab6ccf239',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX76381',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 92734,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_dd0a193ed5c21480c2b3e673229285d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_d9ea48f453a97d34d1953add3867fa86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_245a7afeac4c78c61994b371dccce535.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_2289d71f49de680f85fdd913b9b04739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_ae35e2fc8ea15935a8881274a94464b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_1c5da7f6dd007759b7c058f49b64aae5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0da02e5cc13fb90211c498edf24b244f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c8850c312f7d08d0a6aa7d8ee6e7b3ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_0f0986fe7005f94685763ad80d12497d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f61793-4577-56d3-b71f-499ab6ccf239/e8f61793-4577-56d3-b71f-499ab6ccf239_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/c7/85c7a84de6e6ef2a9b7feb3c68fe7f41/pa/VX76381_c13616ab8d485bb3d2d6bf37d83db040.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX76381%27 HTTP/1.1" 200 None
2026-03-30 12:07:11 [auto1.fr] INFO: Saving data for VX76381: {'created_time': 1774872431.786089, 'last_price_update_time': 1774872431.786101, 'auction_closing_time': 1774969699.0}
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX76381') HTTP/1.1" 204 0
2026-03-30 12:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS87587> (referer: https://www.auto1.com/v1/car-details-view/GS87587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81f86c9-fef8-54de-b59f-3ee261e58704 with identifier: GS87587
2026-03-30 12:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81f86c9-fef8-54de-b59f-3ee261e58704 with scrape type 1
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d81f86c9-fef8-54de-b59f-3ee261e58704
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_10901e048ff33f4e65c172df698edc0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_10901e048ff33f4e65c172df698edc0b.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_54ba506fed484d6bb60f3b05e3684809.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_54ba506fed484d6bb60f3b05e3684809.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_8467eaeaae994e461ffc75d5c8601ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_8467eaeaae994e461ffc75d5c8601ec7.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_757b00998a534d4b19283b33d8ddf57e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_757b00998a534d4b19283b33d8ddf57e.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_ff60a2ddd55a51edbc873beba3f7fd04.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_ff60a2ddd55a51edbc873beba3f7fd04.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_187e44bfd4d8a302e8325b72d5ea1471.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_187e44bfd4d8a302e8325b72d5ea1471.jpg already downloaded
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_300d2377f6f11f670dd6c66301ac3841.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_300d2377f6f11f670dd6c66301ac3841.jpg already downloaded
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_615a813aa5948f69866b6e53d034855c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_615a813aa5948f69866b6e53d034855c.jpg already downloaded
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_43de396200f49ccb31a6c1888e96ca77.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_43de396200f49ccb31a6c1888e96ca77.jpg already downloaded
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F02%252Fb702e50a75a3cc74ec9820dbed9c49cb%252Fpa%252FGS87587_7736a9139199c9a5dfa0b1b537be57d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_7736a9139199c9a5dfa0b1b537be57d2.jpg already downloaded
2026-03-30 12:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d81f86c9-fef8-54de-b59f-3ee261e58704, identifier: GS87587
2026-03-30 12:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d81f86c9-fef8-54de-b59f-3ee261e58704 with identifier: GS87587
2026-03-30 12:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d81f86c9-fef8-54de-b59f-3ee261e58704 with identifier: GS87587
2026-03-30 12:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d81f86c9-fef8-54de-b59f-3ee261e58704 with identifier: GS87587 to the API
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GS87587>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:56:45Z',
'fuel_type': 'diesel',
'id': 'd81f86c9-fef8-54de-b59f-3ee261e58704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS87587',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 58207,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_10901e048ff33f4e65c172df698edc0b.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_54ba506fed484d6bb60f3b05e3684809.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_8467eaeaae994e461ffc75d5c8601ec7.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_757b00998a534d4b19283b33d8ddf57e.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_ff60a2ddd55a51edbc873beba3f7fd04.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_187e44bfd4d8a302e8325b72d5ea1471.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_300d2377f6f11f670dd6c66301ac3841.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_615a813aa5948f69866b6e53d034855c.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_43de396200f49ccb31a6c1888e96ca77.jpg',
'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_7736a9139199c9a5dfa0b1b537be57d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_10901e048ff33f4e65c172df698edc0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_54ba506fed484d6bb60f3b05e3684809.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_8467eaeaae994e461ffc75d5c8601ec7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_757b00998a534d4b19283b33d8ddf57e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_ff60a2ddd55a51edbc873beba3f7fd04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_187e44bfd4d8a302e8325b72d5ea1471.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_300d2377f6f11f670dd6c66301ac3841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_615a813aa5948f69866b6e53d034855c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_43de396200f49ccb31a6c1888e96ca77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d81f86c9-fef8-54de-b59f-3ee261e58704/d81f86c9-fef8-54de-b59f-3ee261e58704_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/02/b702e50a75a3cc74ec9820dbed9c49cb/pa/GS87587_7736a9139199c9a5dfa0b1b537be57d2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-18',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2018}
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS87587%27 HTTP/1.1" 200 None
2026-03-30 12:07:16 [auto1.fr] INFO: Saving data for GS87587: {'created_time': 1774872436.568857, 'last_price_update_time': 1774872436.568867, 'auction_closing_time': 1774972605.0}
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS87587') HTTP/1.1" 204 0
2026-03-30 12:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC27609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR75409> (referer: https://www.auto1.com/v1/car-details-view/FR75409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36978319-24ce-57bf-849a-1db7d5f780e8 with identifier: FR75409
2026-03-30 12:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36978319-24ce-57bf-849a-1db7d5f780e8 with scrape type 1
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36978319-24ce-57bf-849a-1db7d5f780e8
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_d8630c563bf5eecd16cdf4e6d593c8bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_d8630c563bf5eecd16cdf4e6d593c8bd.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_f78ffed493cd8f8ea5b2214d99673d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_f78ffed493cd8f8ea5b2214d99673d5d.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_8a1e3276f67da9e3653b53f03021ad61.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_8a1e3276f67da9e3653b53f03021ad61.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_c3fcdfc611a395c203cad89a74da2ce4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_c3fcdfc611a395c203cad89a74da2ce4.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_ece8fe5c906a84eb9065c3247b7396e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_ece8fe5c906a84eb9065c3247b7396e6.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_7b411e1a144f9c52476f3cef17b802e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_7b411e1a144f9c52476f3cef17b802e0.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_e1c2e3a72567368916016a65cbb2b71f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_e1c2e3a72567368916016a65cbb2b71f.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_97c78f1a231f69eb15f60882414d6ff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_97c78f1a231f69eb15f60882414d6ff5.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_1e2a83d41411627d85080eae53989fff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_1e2a83d41411627d85080eae53989fff.jpg already downloaded
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F91%252F8e916701f7281994c4f3b0f3fa4e383d%252Fpa%252FFR75409_505d68c71ebe25efd683a7ec823f6768.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_505d68c71ebe25efd683a7ec823f6768.jpg already downloaded
2026-03-30 12:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36978319-24ce-57bf-849a-1db7d5f780e8, identifier: FR75409
2026-03-30 12:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36978319-24ce-57bf-849a-1db7d5f780e8 with identifier: FR75409
2026-03-30 12:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36978319-24ce-57bf-849a-1db7d5f780e8 with identifier: FR75409
2026-03-30 12:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36978319-24ce-57bf-849a-1db7d5f780e8 with identifier: FR75409 to the API
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR75409>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:51:56Z',
'fuel_type': 'diesel',
'id': '36978319-24ce-57bf-849a-1db7d5f780e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR75409',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 261076,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_d8630c563bf5eecd16cdf4e6d593c8bd.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_f78ffed493cd8f8ea5b2214d99673d5d.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_8a1e3276f67da9e3653b53f03021ad61.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_c3fcdfc611a395c203cad89a74da2ce4.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_ece8fe5c906a84eb9065c3247b7396e6.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_7b411e1a144f9c52476f3cef17b802e0.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_e1c2e3a72567368916016a65cbb2b71f.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_97c78f1a231f69eb15f60882414d6ff5.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_1e2a83d41411627d85080eae53989fff.jpg',
'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_505d68c71ebe25efd683a7ec823f6768.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_d8630c563bf5eecd16cdf4e6d593c8bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_f78ffed493cd8f8ea5b2214d99673d5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2237038,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_8a1e3276f67da9e3653b53f03021ad61.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_c3fcdfc611a395c203cad89a74da2ce4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_ece8fe5c906a84eb9065c3247b7396e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_7b411e1a144f9c52476f3cef17b802e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2137785,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_e1c2e3a72567368916016a65cbb2b71f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_97c78f1a231f69eb15f60882414d6ff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_1e2a83d41411627d85080eae53989fff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36978319-24ce-57bf-849a-1db7d5f780e8/36978319-24ce-57bf-849a-1db7d5f780e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/91/8e916701f7281994c4f3b0f3fa4e383d/pa/FR75409_505d68c71ebe25efd683a7ec823f6768.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Cup 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Cup 4Motion BlueMotion',
'year': 2014}
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR75409%27 HTTP/1.1" 200 None
2026-03-30 12:07:18 [auto1.fr] INFO: Saving data for FR75409: {'created_time': 1774872438.400602, 'last_price_update_time': 1774872438.400613, 'auction_closing_time': 1774972316.0}
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FR75409') HTTP/1.1" 204 0
2026-03-30 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU09307> (referer: https://www.auto1.com/v1/car-details-view/WU09307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84a88397-5ba3-5116-82f4-5dd0bff2a055 with identifier: WU09307
2026-03-30 12:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84a88397-5ba3-5116-82f4-5dd0bff2a055 with scrape type 1
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84a88397-5ba3-5116-82f4-5dd0bff2a055
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_cb78a83790d11f12a012d7271d6a831c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_cb78a83790d11f12a012d7271d6a831c.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_4747900a5f95445c3c0842e63614bfb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_4747900a5f95445c3c0842e63614bfb3.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_1f17e901067e1eb83e2dea6f830226f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_1f17e901067e1eb83e2dea6f830226f0.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_2effae0db4e0b7aa13c43fea78a5a40b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_2effae0db4e0b7aa13c43fea78a5a40b.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_7fce1a01ba470e82fc91312257e16733.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_7fce1a01ba470e82fc91312257e16733.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_53d55f2846450b210926da1041634eb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_53d55f2846450b210926da1041634eb6.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_11a5e36bf401e37ab128f1a03ce702aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_11a5e36bf401e37ab128f1a03ce702aa.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_fb0e75b8c8fc3f65ffd86725db6c684e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_fb0e75b8c8fc3f65ffd86725db6c684e.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_edf7d2b103ab709befac567d06a3fb27.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_edf7d2b103ab709befac567d06a3fb27.jpg already downloaded
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F0a%252F870a6e916e1e76fdd7383e689c3dd89e%252Fpa%252FWU09307_db2f1d7f801373400362d97bb8dbf43e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_db2f1d7f801373400362d97bb8dbf43e.jpg already downloaded
2026-03-30 12:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 84a88397-5ba3-5116-82f4-5dd0bff2a055, identifier: WU09307
2026-03-30 12:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 84a88397-5ba3-5116-82f4-5dd0bff2a055 with identifier: WU09307
2026-03-30 12:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 84a88397-5ba3-5116-82f4-5dd0bff2a055 with identifier: WU09307
2026-03-30 12:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 84a88397-5ba3-5116-82f4-5dd0bff2a055 with identifier: WU09307 to the API
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU09307>
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:39:05Z',
'fuel_type': 'hybrid',
'id': '84a88397-5ba3-5116-82f4-5dd0bff2a055',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU09307',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Lexus',
'model': 'CT-Serie',
'odometer': 207299,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_cb78a83790d11f12a012d7271d6a831c.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_4747900a5f95445c3c0842e63614bfb3.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_1f17e901067e1eb83e2dea6f830226f0.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_2effae0db4e0b7aa13c43fea78a5a40b.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_7fce1a01ba470e82fc91312257e16733.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_53d55f2846450b210926da1041634eb6.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_11a5e36bf401e37ab128f1a03ce702aa.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_fb0e75b8c8fc3f65ffd86725db6c684e.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_edf7d2b103ab709befac567d06a3fb27.jpg',
'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_db2f1d7f801373400362d97bb8dbf43e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_cb78a83790d11f12a012d7271d6a831c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_4747900a5f95445c3c0842e63614bfb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_1f17e901067e1eb83e2dea6f830226f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_2effae0db4e0b7aa13c43fea78a5a40b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_7fce1a01ba470e82fc91312257e16733.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_53d55f2846450b210926da1041634eb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_11a5e36bf401e37ab128f1a03ce702aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_fb0e75b8c8fc3f65ffd86725db6c684e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_edf7d2b103ab709befac567d06a3fb27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84a88397-5ba3-5116-82f4-5dd0bff2a055/84a88397-5ba3-5116-82f4-5dd0bff2a055_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/0a/870a6e916e1e76fdd7383e689c3dd89e/pa/WU09307_db2f1d7f801373400362d97bb8dbf43e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus CT-Serie CT 200h Emotion',
'transmission': 'automatic',
'trim': 'Emotion',
'year': 2013}
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU09307%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [auto1.fr] INFO: Saving data for WU09307: {'created_time': 1774872448.80294, 'last_price_update_time': 1774872448.802955, 'auction_closing_time': 1774971545.0}
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU09307') HTTP/1.1" 204 0
2026-03-30 12:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:28 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 5702 | hits on page: 40
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: ZN76101
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: RU12813
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: CG93824
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG93824%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [auto1.fr] INFO: Scrape type for CG93824: 1
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: FB52625
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: RN59979
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: BW84332
2026-03-30 12:07:28 [auto1.fr] INFO: Found listing with ID: LP57691
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP57691%27 HTTP/1.1" 200 None
2026-03-30 12:07:28 [auto1.fr] INFO: Scrape type for LP57691: 2
2026-03-30 12:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with identifier: LP57691
2026-03-30 12:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with scrape type 2
2026-03-30 12:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with scrape type 2
2026-03-30 12:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf, identifier: LP57691
2026-03-30 12:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with identifier: LP57691
2026-03-30 12:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with identifier: LP57691
2026-03-30 12:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf with identifier: LP57691 to the API
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:13:16Z',
'fuel_type': 'diesel',
'id': '20dbd4ab-fb5c-5b72-bc39-3ac169d90fbf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP57691',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 63541,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi EcoBlue Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP57691%27 HTTP/1.1" 200 None
2026-03-30 12:07:29 [auto1.fr] INFO: Saving data for LP57691: {'auction_closing_time': 1774969996.0, 'created_time': 1774278689.651311, 'last_price_update_time': 1774872449.908765}
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP57691') HTTP/1.1" 204 0
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: HL77314
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: VL59917
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: BW58605
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: SP58903
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: GD64881
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD64881%27 HTTP/1.1" 200 None
2026-03-30 12:07:29 [auto1.fr] INFO: Scrape type for GD64881: 1
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: DS29137
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS29137%27 HTTP/1.1" 200 None
2026-03-30 12:07:29 [auto1.fr] INFO: Scrape type for DS29137: 1
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: AW56148
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: TE60628
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: HX53685
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: FJ07726
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: TK65775
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: MY85947
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: VG52594
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: KH02703
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: FG53432
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: UE64879
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: WN89162
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: CB03535
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: KF51820
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: NP05223
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: ZW51272
2026-03-30 12:07:29 [auto1.fr] INFO: Found listing with ID: AW82700
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW82700%27 HTTP/1.1" 200 None
2026-03-30 12:07:29 [auto1.fr] INFO: Scrape type for AW82700: 2
2026-03-30 12:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14eb9794-8593-5bc3-a44e-d13ac3906e0e with identifier: AW82700
2026-03-30 12:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14eb9794-8593-5bc3-a44e-d13ac3906e0e with scrape type 2
2026-03-30 12:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14eb9794-8593-5bc3-a44e-d13ac3906e0e with scrape type 2
2026-03-30 12:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14eb9794-8593-5bc3-a44e-d13ac3906e0e, identifier: AW82700
2026-03-30 12:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14eb9794-8593-5bc3-a44e-d13ac3906e0e with identifier: AW82700
2026-03-30 12:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14eb9794-8593-5bc3-a44e-d13ac3906e0e with identifier: AW82700
2026-03-30 12:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14eb9794-8593-5bc3-a44e-d13ac3906e0e with identifier: AW82700 to the API
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:01:55Z',
'fuel_type': 'diesel',
'id': '14eb9794-8593-5bc3-a44e-d13ac3906e0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW82700',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 125470,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'Renault Master 2.3 dCi Energy L2H2 3,5 Grand Confort',
'transmission': 'automatic',
'trim': 'L2H2 3,5 Grand Confort',
'year': 2021}
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW82700%27 HTTP/1.1" 200 None
2026-03-30 12:07:30 [auto1.fr] INFO: Saving data for AW82700: {'auction_closing_time': 1774969315.0, 'created_time': 1774001978.067815, 'last_price_update_time': 1774872450.396082}
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW82700') HTTP/1.1" 204 0
2026-03-30 12:07:30 [auto1.fr] INFO: Found listing with ID: LF08088
2026-03-30 12:07:30 [auto1.fr] INFO: Found listing with ID: RA43033
2026-03-30 12:07:30 [auto1.fr] INFO: Found listing with ID: AT92425
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT92425%27 HTTP/1.1" 200 None
2026-03-30 12:07:30 [auto1.fr] INFO: Scrape type for AT92425: 2
2026-03-30 12:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-03-30 12:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033862a7-3ba1-5a52-943a-d1d62936387e with scrape type 2
2026-03-30 12:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033862a7-3ba1-5a52-943a-d1d62936387e with scrape type 2
2026-03-30 12:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 033862a7-3ba1-5a52-943a-d1d62936387e, identifier: AT92425
2026-03-30 12:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-03-30 12:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425
2026-03-30 12:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 033862a7-3ba1-5a52-943a-d1d62936387e with identifier: AT92425 to the API
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:10:13Z',
'fuel_type': 'diesel',
'id': '033862a7-3ba1-5a52-943a-d1d62936387e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT92425',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 203709,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-05',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT92425%27 HTTP/1.1" 200 None
2026-03-30 12:07:30 [auto1.fr] INFO: Saving data for AT92425: {'auction_closing_time': 1774969813.0, 'created_time': 1773664282.120723, 'last_price_update_time': 1774872450.972816}
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AT92425') HTTP/1.1" 204 0
2026-03-30 12:07:30 [auto1.fr] INFO: Found listing with ID: GZ04122
2026-03-30 12:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ04122%27 HTTP/1.1" 200 None
2026-03-30 12:07:31 [auto1.fr] INFO: Scrape type for GZ04122: 1
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: DB27239
2026-03-30 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB27239%27 HTTP/1.1" 200 None
2026-03-30 12:07:31 [auto1.fr] INFO: Scrape type for DB27239: 1
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: CG67141
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: BH16535
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: GS18413
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: JV34550
2026-03-30 12:07:31 [auto1.fr] INFO: Found listing with ID: ER38330
2026-03-30 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER38330%27 HTTP/1.1" 200 None
2026-03-30 12:07:31 [auto1.fr] INFO: Scrape type for ER38330: 1
2026-03-30 12:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH75787> (referer: https://www.auto1.com/v1/car-details-view/PH75787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0acd0af9-4197-5948-9b8e-cba7d9207d65 with identifier: PH75787
2026-03-30 12:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0acd0af9-4197-5948-9b8e-cba7d9207d65 with scrape type 1
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_8227933729fd9859ce54c3f26f360359.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_8227933729fd9859ce54c3f26f360359.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_207901239fbd7e09596e67a492bed294.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_207901239fbd7e09596e67a492bed294.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_3a28c1c181d5edde19b193aecb43932b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_3a28c1c181d5edde19b193aecb43932b.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_58f1167f4be77d27f7679553a0070776.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_58f1167f4be77d27f7679553a0070776.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_698951145e87faa0eed13ae69be27d57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_698951145e87faa0eed13ae69be27d57.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_0c77d36118323dc298979fbc20423fef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_0c77d36118323dc298979fbc20423fef.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_645ba6f7374c6fdede137024214acaf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_645ba6f7374c6fdede137024214acaf0.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_c92042007b7e3d9a139148a296d64b29.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_c92042007b7e3d9a139148a296d64b29.jpg not downloaded yet
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg not downloaded yet
2026-03-30 12:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP91950/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfde10>
2026-03-30 12:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg saved to cache
2026-03-30 12:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG22650> (referer: https://www.auto1.com/v1/car-details-view/FG22650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba1977a3-34d3-59ad-bffe-071eee6a1b93 with identifier: FG22650
2026-03-30 12:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba1977a3-34d3-59ad-bffe-071eee6a1b93 with scrape type 1
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba1977a3-34d3-59ad-bffe-071eee6a1b93
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_2ce0a601ad3f8dbc6d28b3598741396e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_2ce0a601ad3f8dbc6d28b3598741396e.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_3abb0b9aedf95afa994d0a7217a65115.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_3abb0b9aedf95afa994d0a7217a65115.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_77841adb82a9518ccb4d9b6e32bcb16d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_77841adb82a9518ccb4d9b6e32bcb16d.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_6440becd8707dd891810180a3abae0cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_6440becd8707dd891810180a3abae0cf.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_5fb9e610d19f9a89fca36b13ab783d3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_5fb9e610d19f9a89fca36b13ab783d3f.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_a92879e35bcb66cda043af0d5d6a6cec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_a92879e35bcb66cda043af0d5d6a6cec.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_9118d5bafac8ce6d13eb2cb989c3f08e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_9118d5bafac8ce6d13eb2cb989c3f08e.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_54dcac5fa6136e378c00dbe5ea554131.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_54dcac5fa6136e378c00dbe5ea554131.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_7139dd105d19ed81069513655347b136.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_7139dd105d19ed81069513655347b136.jpg already downloaded
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fef%252F9fef36abb19175e1c524b7f453c549d3%252Fpa%252FFG22650_0d860dd669e1735ec5a12720f9d673dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_0d860dd669e1735ec5a12720f9d673dd.jpg already downloaded
2026-03-30 12:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ba1977a3-34d3-59ad-bffe-071eee6a1b93, identifier: FG22650
2026-03-30 12:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ba1977a3-34d3-59ad-bffe-071eee6a1b93 with identifier: FG22650
2026-03-30 12:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ba1977a3-34d3-59ad-bffe-071eee6a1b93 with identifier: FG22650
2026-03-30 12:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ba1977a3-34d3-59ad-bffe-071eee6a1b93 with identifier: FG22650 to the API
2026-03-30 12:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG22650>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:20:32Z',
'fuel_type': 'diesel',
'id': 'ba1977a3-34d3-59ad-bffe-071eee6a1b93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG22650',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '2008',
'odometer': 84495,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_2ce0a601ad3f8dbc6d28b3598741396e.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_3abb0b9aedf95afa994d0a7217a65115.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_77841adb82a9518ccb4d9b6e32bcb16d.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_6440becd8707dd891810180a3abae0cf.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_5fb9e610d19f9a89fca36b13ab783d3f.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_a92879e35bcb66cda043af0d5d6a6cec.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_9118d5bafac8ce6d13eb2cb989c3f08e.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_54dcac5fa6136e378c00dbe5ea554131.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_7139dd105d19ed81069513655347b136.jpg',
'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_0d860dd669e1735ec5a12720f9d673dd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3106923,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_2ce0a601ad3f8dbc6d28b3598741396e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_3abb0b9aedf95afa994d0a7217a65115.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_77841adb82a9518ccb4d9b6e32bcb16d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_6440becd8707dd891810180a3abae0cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_5fb9e610d19f9a89fca36b13ab783d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_a92879e35bcb66cda043af0d5d6a6cec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_9118d5bafac8ce6d13eb2cb989c3f08e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_54dcac5fa6136e378c00dbe5ea554131.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_7139dd105d19ed81069513655347b136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba1977a3-34d3-59ad-bffe-071eee6a1b93/ba1977a3-34d3-59ad-bffe-071eee6a1b93_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/ef/9fef36abb19175e1c524b7f453c549d3/pa/FG22650_0d860dd669e1735ec5a12720f9d673dd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG22650%27 HTTP/1.1" 200 None
2026-03-30 12:07:42 [auto1.fr] INFO: Saving data for FG22650: {'created_time': 1774872462.118786, 'last_price_update_time': 1774872462.118797, 'auction_closing_time': 1774970432.0}
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG22650') HTTP/1.1" 204 0
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_c92042007b7e3d9a139148a296d64b29.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfd1d0>
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_c92042007b7e3d9a139148a296d64b29.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_c92042007b7e3d9a139148a296d64b29.jpg saved to cache
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c06690>
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg saved to cache
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_645ba6f7374c6fdede137024214acaf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285154a90>
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_645ba6f7374c6fdede137024214acaf0.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_645ba6f7374c6fdede137024214acaf0.jpg saved to cache
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_0c77d36118323dc298979fbc20423fef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a61d90>
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_0c77d36118323dc298979fbc20423fef.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_0c77d36118323dc298979fbc20423fef.jpg saved to cache
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_698951145e87faa0eed13ae69be27d57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a0e50>
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_698951145e87faa0eed13ae69be27d57.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_698951145e87faa0eed13ae69be27d57.jpg saved to cache
2026-03-30 12:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_58f1167f4be77d27f7679553a0070776.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a0250>
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_58f1167f4be77d27f7679553a0070776.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_58f1167f4be77d27f7679553a0070776.jpg saved to cache
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_3a28c1c181d5edde19b193aecb43932b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285155b10>
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_3a28c1c181d5edde19b193aecb43932b.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_3a28c1c181d5edde19b193aecb43932b.jpg saved to cache
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_207901239fbd7e09596e67a492bed294.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_8227933729fd9859ce54c3f26f360359.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a4ca10>
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_207901239fbd7e09596e67a492bed294.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_207901239fbd7e09596e67a492bed294.jpg saved to cache
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6b6d0>
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F29%252Fa52941a5f17c8b0fe76d00024d56c1b4%252Fpa%252FPH75787_8227933729fd9859ce54c3f26f360359.jpg') HTTP/1.1" 204 0
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_8227933729fd9859ce54c3f26f360359.jpg saved to cache
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0acd0af9-4197-5948-9b8e-cba7d9207d65
2026-03-30 12:07:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0acd0af9-4197-5948-9b8e-cba7d9207d65, skipping ID generation
2026-03-30 12:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0acd0af9-4197-5948-9b8e-cba7d9207d65 with scrape type 1
2026-03-30 12:07:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0acd0af9-4197-5948-9b8e-cba7d9207d65 sending to next pipeline
2026-03-30 12:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0acd0af9-4197-5948-9b8e-cba7d9207d65, identifier: PH75787
2026-03-30 12:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0acd0af9-4197-5948-9b8e-cba7d9207d65 with identifier: PH75787
2026-03-30 12:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0acd0af9-4197-5948-9b8e-cba7d9207d65 with identifier: PH75787
2026-03-30 12:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0acd0af9-4197-5948-9b8e-cba7d9207d65 with identifier: PH75787 to the API
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_8227933729fd9859ce54c3f26f360359.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:35:15Z',
'fuel_type': 'diesel',
'id': '0acd0af9-4197-5948-9b8e-cba7d9207d65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH75787',
'listing': 'auction',
'location': "FR, Villeneuve d'Ascq",
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 185991,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_8227933729fd9859ce54c3f26f360359.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_207901239fbd7e09596e67a492bed294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_3a28c1c181d5edde19b193aecb43932b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_58f1167f4be77d27f7679553a0070776.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_698951145e87faa0eed13ae69be27d57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_0c77d36118323dc298979fbc20423fef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_645ba6f7374c6fdede137024214acaf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_e2e86d945ec65f31b3a95bbcb50234d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_c92042007b7e3d9a139148a296d64b29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0acd0af9-4197-5948-9b8e-cba7d9207d65/0acd0af9-4197-5948-9b8e-cba7d9207d65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/29/a52941a5f17c8b0fe76d00024d56c1b4/pa/PH75787_b9769f48ef11521bcd9c653e5eb664dc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Comfort 2WD',
'transmission': 'automatic',
'trim': 'Comfort 2WD',
'year': 2017}
2026-03-30 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH75787%27 HTTP/1.1" 200 None
2026-03-30 12:07:44 [auto1.fr] INFO: Saving data for PH75787: {'created_time': 1774872464.05356, 'last_price_update_time': 1774872464.053575, 'auction_closing_time': 1774971315.0}
2026-03-30 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH75787') HTTP/1.1" 204 0
2026-03-30 12:07:58 [scrapy.extensions.logstats] INFO: Crawled 152 pages (at 15 pages/min), scraped 145 items (at 11 items/min)
2026-03-30 12:07:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:08:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.232(s), this was the 1st time calling it.
2026-03-30 12:08:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.370037369443059 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:08:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.635(s), this was the 1st time calling it.
2026-03-30 12:08:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.0336585328568964 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:08:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE60307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.895(s), this was the 1st time calling it.
2026-03-30 12:08:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.763621498673176 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH28225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:58 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 2 pages/min), scraped 145 items (at 0 items/min)
2026-03-30 12:08:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.029(s), this was the 1st time calling it.
2026-03-30 12:09:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.696366523184197 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.030(s), this was the 1st time calling it.
2026-03-30 12:09:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9040297131353623 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV16401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB23264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:09 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 5705 | hits on page: 40
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: GS18413
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: JV34550
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: ER38330
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: FJ22244
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ22244%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for FJ22244: 1
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: LX65836
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: DP63747
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: ZG20237
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: AW25296
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW25296%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for AW25296: 1
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: RY21816
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: VS89734
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: EU27983
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: YG27140
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG27140%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for YG27140: 2
2026-03-30 12:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd08bb2-3c4b-5f26-9373-320880fbff40 with identifier: YG27140
2026-03-30 12:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd08bb2-3c4b-5f26-9373-320880fbff40 with scrape type 2
2026-03-30 12:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd08bb2-3c4b-5f26-9373-320880fbff40 with scrape type 2
2026-03-30 12:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9bd08bb2-3c4b-5f26-9373-320880fbff40, identifier: YG27140
2026-03-30 12:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9bd08bb2-3c4b-5f26-9373-320880fbff40 with identifier: YG27140
2026-03-30 12:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9bd08bb2-3c4b-5f26-9373-320880fbff40 with identifier: YG27140
2026-03-30 12:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9bd08bb2-3c4b-5f26-9373-320880fbff40 with identifier: YG27140 to the API
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:58:18Z',
'fuel_type': 'diesel',
'id': '9bd08bb2-3c4b-5f26-9373-320880fbff40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG27140',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa 159',
'odometer': 167891,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-01',
'seller_name': None,
'title': 'Alfa Romeo Alfa 159 1.9 JTD JTDM Distinctive',
'transmission': 'manual',
'trim': 'JTDM Distinctive',
'year': 2006}
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG27140%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Saving data for YG27140: {'auction_closing_time': 1774972698.0, 'created_time': 1774279518.037484, 'last_price_update_time': 1774872549.589883}
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG27140') HTTP/1.1" 204 0
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: FV30142
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV30142%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for FV30142: 1
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: KF38228
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: LT07555
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: GL54239
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: GC36158
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC36158%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for GC36158: 1
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: YY74823
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: GP91478
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: NP08318
2026-03-30 12:09:09 [auto1.fr] INFO: Found listing with ID: XC44786
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC44786%27 HTTP/1.1" 200 None
2026-03-30 12:09:09 [auto1.fr] INFO: Scrape type for XC44786: 2
2026-03-30 12:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df857436-ea9d-5dc5-8025-85ea22283c1c with identifier: XC44786
2026-03-30 12:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df857436-ea9d-5dc5-8025-85ea22283c1c with scrape type 2
2026-03-30 12:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df857436-ea9d-5dc5-8025-85ea22283c1c with scrape type 2
2026-03-30 12:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df857436-ea9d-5dc5-8025-85ea22283c1c, identifier: XC44786
2026-03-30 12:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df857436-ea9d-5dc5-8025-85ea22283c1c with identifier: XC44786
2026-03-30 12:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df857436-ea9d-5dc5-8025-85ea22283c1c with identifier: XC44786
2026-03-30 12:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df857436-ea9d-5dc5-8025-85ea22283c1c with identifier: XC44786 to the API
2026-03-30 12:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:32:12Z',
'fuel_type': 'diesel',
'id': 'df857436-ea9d-5dc5-8025-85ea22283c1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC44786',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 129396,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-24',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2019}
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC44786%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Saving data for XC44786: {'auction_closing_time': 1774971132.0, 'created_time': 1774696654.421151, 'last_price_update_time': 1774872550.181602}
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XC44786') HTTP/1.1" 204 0
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: BD89729
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: PV10866
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: MV42781
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: WX31823
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: GD81242
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: DH43299
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: EE45752
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: MN56014
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: DD87525
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD87525%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Scrape type for DD87525: 2
2026-03-30 12:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 265e4241-58a6-56be-965e-2da676cca9a9 with identifier: DD87525
2026-03-30 12:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 265e4241-58a6-56be-965e-2da676cca9a9 with scrape type 2
2026-03-30 12:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 265e4241-58a6-56be-965e-2da676cca9a9 with scrape type 2
2026-03-30 12:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 265e4241-58a6-56be-965e-2da676cca9a9, identifier: DD87525
2026-03-30 12:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 265e4241-58a6-56be-965e-2da676cca9a9 with identifier: DD87525
2026-03-30 12:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 265e4241-58a6-56be-965e-2da676cca9a9 with identifier: DD87525
2026-03-30 12:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 265e4241-58a6-56be-965e-2da676cca9a9 with identifier: DD87525 to the API
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:42:58Z',
'fuel_type': 'petrol',
'id': '265e4241-58a6-56be-965e-2da676cca9a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD87525',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 24029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2017}
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD87525%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Saving data for DD87525: {'auction_closing_time': 1774971778.0, 'created_time': 1773254547.620003, 'last_price_update_time': 1774872550.662329}
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD87525') HTTP/1.1" 204 0
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: JR34366
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: SC12809
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: EW99844
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW99844%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Scrape type for EW99844: 1
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: AW44269
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: KB70829
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: VY12323
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: JS02864
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS02864%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Scrape type for JS02864: 1
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: JE60275
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: TP56731
2026-03-30 12:09:10 [auto1.fr] INFO: Found listing with ID: SL97840
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL97840%27 HTTP/1.1" 200 None
2026-03-30 12:09:10 [auto1.fr] INFO: Scrape type for SL97840: 2
2026-03-30 12:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66108ed9-f840-5c25-8ea6-6944acf2e5ae with identifier: SL97840
2026-03-30 12:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66108ed9-f840-5c25-8ea6-6944acf2e5ae with scrape type 2
2026-03-30 12:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66108ed9-f840-5c25-8ea6-6944acf2e5ae with scrape type 2
2026-03-30 12:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66108ed9-f840-5c25-8ea6-6944acf2e5ae, identifier: SL97840
2026-03-30 12:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66108ed9-f840-5c25-8ea6-6944acf2e5ae with identifier: SL97840
2026-03-30 12:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66108ed9-f840-5c25-8ea6-6944acf2e5ae with identifier: SL97840
2026-03-30 12:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66108ed9-f840-5c25-8ea6-6944acf2e5ae with identifier: SL97840 to the API
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:05:56Z',
'fuel_type': 'diesel',
'id': '66108ed9-f840-5c25-8ea6-6944acf2e5ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL97840',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 125847,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-09',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL97840%27 HTTP/1.1" 200 None
2026-03-30 12:09:11 [auto1.fr] INFO: Saving data for SL97840: {'auction_closing_time': 1774969556.0, 'created_time': 1772612987.756781, 'last_price_update_time': 1774872551.346531}
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SL97840') HTTP/1.1" 204 0
2026-03-30 12:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB24231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER38330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY82143/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP91950> (referer: https://www.auto1.com/v1/car-details-view/SP91950/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG93824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf980ce-012e-5089-99b4-a94d84ed984a with identifier: SP91950
2026-03-30 12:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf980ce-012e-5089-99b4-a94d84ed984a with scrape type 1
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_e04ee6520c40ad360a19e2016b574967.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_e04ee6520c40ad360a19e2016b574967.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_0b8114638bf950bd76f6598504caa800.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_0b8114638bf950bd76f6598504caa800.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_570b5b7e9cdb7c086904a29d99f83182.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_570b5b7e9cdb7c086904a29d99f83182.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_d68db1e9ddd1146674114dcbe45fe511.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d68db1e9ddd1146674114dcbe45fe511.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_270d86acb31480d2fd1a0ffe81e67544.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_270d86acb31480d2fd1a0ffe81e67544.jpg not downloaded yet
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg not downloaded yet
2026-03-30 12:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ04122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b31890>
2026-03-30 12:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg saved to cache
2026-03-30 12:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.991(s), this was the 1st time calling it.
2026-03-30 12:09:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.351580311250283 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB27239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_270d86acb31480d2fd1a0ffe81e67544.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d68db1e9ddd1146674114dcbe45fe511.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c04910>
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_270d86acb31480d2fd1a0ffe81e67544.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_270d86acb31480d2fd1a0ffe81e67544.jpg saved to cache
2026-03-30 12:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513f6d0>
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_d68db1e9ddd1146674114dcbe45fe511.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d68db1e9ddd1146674114dcbe45fe511.jpg saved to cache
2026-03-30 12:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE60307> (referer: https://www.auto1.com/v1/car-details-view/KE60307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28c788c0-c235-5432-92e4-4cb8e5184e26 with identifier: KE60307
2026-03-30 12:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28c788c0-c235-5432-92e4-4cb8e5184e26 with scrape type 1
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28c788c0-c235-5432-92e4-4cb8e5184e26
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_7e67c38d1929c2a2530f932751ec34b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7e67c38d1929c2a2530f932751ec34b6.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_c24f28f6d7c4c6aff802fa63ef6096f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_c24f28f6d7c4c6aff802fa63ef6096f5.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_17e4d02e6b10708a8ad09eae4a7e5b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_17e4d02e6b10708a8ad09eae4a7e5b70.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_9a95498b753070bb27a393e7cfc8de6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_9a95498b753070bb27a393e7cfc8de6e.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_7b4fbe6ac51410f4fd682db128cc73b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7b4fbe6ac51410f4fd682db128cc73b0.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_437830afe11ab4ed093769348a773a74.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_437830afe11ab4ed093769348a773a74.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_0a7a00c219cf6ecef036e65d717b34ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_0a7a00c219cf6ecef036e65d717b34ad.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_373486a8b3dc75316b9368f24ed97166.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_373486a8b3dc75316b9368f24ed97166.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_55974cb01bad62ca8ec5e57745b08f5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_55974cb01bad62ca8ec5e57745b08f5b.jpg already downloaded
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F0e%252F470e4a2bf386e898e8dc98bd61a369e5%252Fpa%252FKE60307_36af2f86b6688dde70c527d4fa8a496d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_36af2f86b6688dde70c527d4fa8a496d.jpg already downloaded
2026-03-30 12:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 28c788c0-c235-5432-92e4-4cb8e5184e26, identifier: KE60307
2026-03-30 12:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 28c788c0-c235-5432-92e4-4cb8e5184e26 with identifier: KE60307
2026-03-30 12:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 28c788c0-c235-5432-92e4-4cb8e5184e26 with identifier: KE60307
2026-03-30 12:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 28c788c0-c235-5432-92e4-4cb8e5184e26 with identifier: KE60307 to the API
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KE60307>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:31:56Z',
'fuel_type': 'diesel',
'id': '28c788c0-c235-5432-92e4-4cb8e5184e26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE60307',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 206333,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7e67c38d1929c2a2530f932751ec34b6.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_c24f28f6d7c4c6aff802fa63ef6096f5.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_17e4d02e6b10708a8ad09eae4a7e5b70.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_9a95498b753070bb27a393e7cfc8de6e.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7b4fbe6ac51410f4fd682db128cc73b0.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_437830afe11ab4ed093769348a773a74.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_0a7a00c219cf6ecef036e65d717b34ad.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_373486a8b3dc75316b9368f24ed97166.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_55974cb01bad62ca8ec5e57745b08f5b.jpg',
'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_36af2f86b6688dde70c527d4fa8a496d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7e67c38d1929c2a2530f932751ec34b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2989986,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_c24f28f6d7c4c6aff802fa63ef6096f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_17e4d02e6b10708a8ad09eae4a7e5b70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_9a95498b753070bb27a393e7cfc8de6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3051836,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_7b4fbe6ac51410f4fd682db128cc73b0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_437830afe11ab4ed093769348a773a74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424243,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_0a7a00c219cf6ecef036e65d717b34ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_373486a8b3dc75316b9368f24ed97166.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_55974cb01bad62ca8ec5e57745b08f5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28c788c0-c235-5432-92e4-4cb8e5184e26/28c788c0-c235-5432-92e4-4cb8e5184e26_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/0e/470e4a2bf386e898e8dc98bd61a369e5/pa/KE60307_36af2f86b6688dde70c527d4fa8a496d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE60307%27 HTTP/1.1" 200 None
2026-03-30 12:09:23 [auto1.fr] INFO: Saving data for KE60307: {'created_time': 1774872563.610012, 'last_price_update_time': 1774872563.610024, 'auction_closing_time': 1774971116.0}
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KE60307') HTTP/1.1" 204 0
2026-03-30 12:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c07c50>
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg saved to cache
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850eb610>
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg saved to cache
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c67cd0>
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg saved to cache
2026-03-30 12:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH28225> (referer: https://www.auto1.com/v1/car-details-view/LH28225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9 with identifier: LH28225
2026-03-30 12:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9 with scrape type 1
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_767cf8b141211f82b71dfc94ac550770.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_767cf8b141211f82b71dfc94ac550770.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_24e64e5ba117260ec5bef2e43afe87ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_24e64e5ba117260ec5bef2e43afe87ce.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_86111d4403440db0a72199664553ce79.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_86111d4403440db0a72199664553ce79.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_97f2c1498e70ceb7cffc16005c60571c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_97f2c1498e70ceb7cffc16005c60571c.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_61ee20a54de2a39b45007a5bca8ff9a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_61ee20a54de2a39b45007a5bca8ff9a1.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_3c0e971681e1545284ce32d3ebf975f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_3c0e971681e1545284ce32d3ebf975f0.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_597cd0e3d65c6fc7cde933a82e995546.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_597cd0e3d65c6fc7cde933a82e995546.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_e516d40e3d1c8d44e714e824ce1107cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_e516d40e3d1c8d44e714e824ce1107cc.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_4ee0798b8d2e95fe72c9fbf5fd7e9407.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_4ee0798b8d2e95fe72c9fbf5fd7e9407.jpg already downloaded
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F69%252F7269daff5e12207a541c001aa095173e%252Fpa%252FLH28225_6e9520c743a32ee67047994e3a6e3409.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_6e9520c743a32ee67047994e3a6e3409.jpg already downloaded
2026-03-30 12:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9, identifier: LH28225
2026-03-30 12:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9 with identifier: LH28225
2026-03-30 12:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9 with identifier: LH28225
2026-03-30 12:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19cc91b9-2b5c-5008-b6c3-17761d8ff6e9 with identifier: LH28225 to the API
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LH28225>
{'auction_title': '',
'c_o_2_emission_value': 44,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.9L',
'engine_horse_power': 306,
'expiration_date': '2026-03-31T15:48:26Z',
'fuel_type': 'hybrid',
'id': '19cc91b9-2b5c-5008-b6c3-17761d8ff6e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH28225',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 196885,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_767cf8b141211f82b71dfc94ac550770.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_24e64e5ba117260ec5bef2e43afe87ce.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_86111d4403440db0a72199664553ce79.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_97f2c1498e70ceb7cffc16005c60571c.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_61ee20a54de2a39b45007a5bca8ff9a1.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_3c0e971681e1545284ce32d3ebf975f0.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_597cd0e3d65c6fc7cde933a82e995546.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_e516d40e3d1c8d44e714e824ce1107cc.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_4ee0798b8d2e95fe72c9fbf5fd7e9407.jpg',
'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_6e9520c743a32ee67047994e3a6e3409.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771587,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_767cf8b141211f82b71dfc94ac550770.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_24e64e5ba117260ec5bef2e43afe87ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669996,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_86111d4403440db0a72199664553ce79.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2820186,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_97f2c1498e70ceb7cffc16005c60571c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2570651,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_61ee20a54de2a39b45007a5bca8ff9a1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2377403,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_3c0e971681e1545284ce32d3ebf975f0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2350617,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_597cd0e3d65c6fc7cde933a82e995546.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2411691,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_e516d40e3d1c8d44e714e824ce1107cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2712326,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_4ee0798b8d2e95fe72c9fbf5fd7e9407.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19cc91b9-2b5c-5008-b6c3-17761d8ff6e9/19cc91b9-2b5c-5008-b6c3-17761d8ff6e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2161713,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img72/69/7269daff5e12207a541c001aa095173e/pa/LH28225_6e9520c743a32ee67047994e3a6e3409.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH28225%27 HTTP/1.1" 200 None
2026-03-30 12:09:28 [auto1.fr] INFO: Saving data for LH28225: {'created_time': 1774872568.986438, 'last_price_update_time': 1774872568.986449, 'auction_closing_time': 1774972106.0}
2026-03-30 12:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LH28225') HTTP/1.1" 204 0
2026-03-30 12:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_570b5b7e9cdb7c086904a29d99f83182.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV16401> (referer: https://www.auto1.com/v1/car-details-view/KV16401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a78390>
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg saved to cache
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b336d0>
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_570b5b7e9cdb7c086904a29d99f83182.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_570b5b7e9cdb7c086904a29d99f83182.jpg saved to cache
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_0b8114638bf950bd76f6598504caa800.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29723dc5-fe42-5f3e-bdf2-71f805c9ca01 with identifier: KV16401
2026-03-30 12:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29723dc5-fe42-5f3e-bdf2-71f805c9ca01 with scrape type 1
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29723dc5-fe42-5f3e-bdf2-71f805c9ca01
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_9a389a7aac0d387547d1d86d33f21a1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_9a389a7aac0d387547d1d86d33f21a1f.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_110d3ac7574c4257167b22abfdfddaf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_110d3ac7574c4257167b22abfdfddaf6.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_a86004e1372a6803d8172d0fc475feac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_a86004e1372a6803d8172d0fc475feac.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_6a3ea4afdfc757fac7b1492972cac8d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_6a3ea4afdfc757fac7b1492972cac8d6.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_dcc8b40e3ea4beebb0a6f478637e5f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_dcc8b40e3ea4beebb0a6f478637e5f87.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_fd68230541675630d3b962fce401f3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_fd68230541675630d3b962fce401f3d5.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_5baa9c00af120ebd62a440ce468cf510.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_5baa9c00af120ebd62a440ce468cf510.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_d9530bca7d1f1b5fd47f803d142e34f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_d9530bca7d1f1b5fd47f803d142e34f3.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_c48c5be47d605cdde2ed463da8e8e25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_c48c5be47d605cdde2ed463da8e8e25f.jpg already downloaded
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Faf%252Fc4af7b34df3e5cd6dbfe54296a164190%252Fpa%252FKV16401_f7714f84fd3b0f720e06c65630351245.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_f7714f84fd3b0f720e06c65630351245.jpg already downloaded
2026-03-30 12:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29723dc5-fe42-5f3e-bdf2-71f805c9ca01, identifier: KV16401
2026-03-30 12:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29723dc5-fe42-5f3e-bdf2-71f805c9ca01 with identifier: KV16401
2026-03-30 12:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29723dc5-fe42-5f3e-bdf2-71f805c9ca01 with identifier: KV16401
2026-03-30 12:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 29723dc5-fe42-5f3e-bdf2-71f805c9ca01 with identifier: KV16401 to the API
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV16401>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:47:39Z',
'fuel_type': 'diesel',
'id': '29723dc5-fe42-5f3e-bdf2-71f805c9ca01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV16401',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'BMW',
'model': '1er',
'odometer': 134669,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_9a389a7aac0d387547d1d86d33f21a1f.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_110d3ac7574c4257167b22abfdfddaf6.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_a86004e1372a6803d8172d0fc475feac.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_6a3ea4afdfc757fac7b1492972cac8d6.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_dcc8b40e3ea4beebb0a6f478637e5f87.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_fd68230541675630d3b962fce401f3d5.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_5baa9c00af120ebd62a440ce468cf510.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_d9530bca7d1f1b5fd47f803d142e34f3.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_c48c5be47d605cdde2ed463da8e8e25f.jpg',
'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_f7714f84fd3b0f720e06c65630351245.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_9a389a7aac0d387547d1d86d33f21a1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_110d3ac7574c4257167b22abfdfddaf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_a86004e1372a6803d8172d0fc475feac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_6a3ea4afdfc757fac7b1492972cac8d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_dcc8b40e3ea4beebb0a6f478637e5f87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_fd68230541675630d3b962fce401f3d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_5baa9c00af120ebd62a440ce468cf510.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_d9530bca7d1f1b5fd47f803d142e34f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_c48c5be47d605cdde2ed463da8e8e25f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29723dc5-fe42-5f3e-bdf2-71f805c9ca01/29723dc5-fe42-5f3e-bdf2-71f805c9ca01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/af/c4af7b34df3e5cd6dbfe54296a164190/pa/KV16401_f7714f84fd3b0f720e06c65630351245.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-10',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 120d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV16401%27 HTTP/1.1" 200 None
2026-03-30 12:09:29 [auto1.fr] INFO: Saving data for KV16401: {'created_time': 1774872569.782206, 'last_price_update_time': 1774872569.782217, 'auction_closing_time': 1774972059.0}
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV16401') HTTP/1.1" 204 0
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c1d290>
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_0b8114638bf950bd76f6598504caa800.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_0b8114638bf950bd76f6598504caa800.jpg saved to cache
2026-03-30 12:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_e04ee6520c40ad360a19e2016b574967.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c66d90>
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fe9%252F08e993723cd4b8a4a29bf0bc6f710e35%252Fpa%252FSP91950_e04ee6520c40ad360a19e2016b574967.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_e04ee6520c40ad360a19e2016b574967.jpg saved to cache
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cf980ce-012e-5089-99b4-a94d84ed984a
2026-03-30 12:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cf980ce-012e-5089-99b4-a94d84ed984a, skipping ID generation
2026-03-30 12:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf980ce-012e-5089-99b4-a94d84ed984a with scrape type 1
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cf980ce-012e-5089-99b4-a94d84ed984a sending to next pipeline
2026-03-30 12:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0cf980ce-012e-5089-99b4-a94d84ed984a, identifier: SP91950
2026-03-30 12:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0cf980ce-012e-5089-99b4-a94d84ed984a with identifier: SP91950
2026-03-30 12:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0cf980ce-012e-5089-99b4-a94d84ed984a with identifier: SP91950
2026-03-30 12:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0cf980ce-012e-5089-99b4-a94d84ed984a with identifier: SP91950 to the API
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_e04ee6520c40ad360a19e2016b574967.jpg>
{'auction_title': '',
'c_o_2_emission_value': 184,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:35:49Z',
'fuel_type': 'diesel',
'id': '0cf980ce-012e-5089-99b4-a94d84ed984a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP91950',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Audi',
'model': 'Q5',
'odometer': 242104,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_e04ee6520c40ad360a19e2016b574967.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_0b8114638bf950bd76f6598504caa800.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_570b5b7e9cdb7c086904a29d99f83182.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_eb8f333da8c2a8c53d3f08ef20556491.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_b142d7b95f1bb25407bd8131f22bb12d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d6c2d1cce4eff827a7fa0ffb9b8c0927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_8995b37a28a36e6bf35ab35f512c2e25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_d68db1e9ddd1146674114dcbe45fe511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_270d86acb31480d2fd1a0ffe81e67544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf980ce-012e-5089-99b4-a94d84ed984a/0cf980ce-012e-5089-99b4-a94d84ed984a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/e9/08e993723cd4b8a4a29bf0bc6f710e35/pa/SP91950_c716ced2abd95c9e11faf27fcde4fda5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Ambition Luxe',
'transmission': 'automatic',
'trim': 'quattro Ambition Luxe',
'year': 2011}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP91950%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [auto1.fr] INFO: Saving data for SP91950: {'created_time': 1774872570.439086, 'last_price_update_time': 1774872570.439097, 'auction_closing_time': 1774971349.0}
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SP91950') HTTP/1.1" 204 0
2026-03-30 12:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB66153> (referer: https://www.auto1.com/v1/car-details-view/WB66153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf082a5a-47a7-54bf-a9cf-fa53d72e6740 with identifier: WB66153
2026-03-30 12:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf082a5a-47a7-54bf-a9cf-fa53d72e6740 with scrape type 1
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf082a5a-47a7-54bf-a9cf-fa53d72e6740
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_aca078ec98228b4e5ed143076920d801.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_aca078ec98228b4e5ed143076920d801.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_9d2b6553382d3578f2d6f15cd369cd0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_9d2b6553382d3578f2d6f15cd369cd0d.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_8afb61165fce325bbe5fa4d25525895f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8afb61165fce325bbe5fa4d25525895f.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_7b8f3352ab2921113a7801ed98748bcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7b8f3352ab2921113a7801ed98748bcf.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_6d555407b27781e8c67a16b295fca4a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_6d555407b27781e8c67a16b295fca4a0.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_4d9db3bbed8219a07d2ba66dd885c559.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_4d9db3bbed8219a07d2ba66dd885c559.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_7a9cc95742c221c793e9db70cc75463f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7a9cc95742c221c793e9db70cc75463f.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_c05a36bf9183855fb64b41b268f20d5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_c05a36bf9183855fb64b41b268f20d5c.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_a6f6d1cfd8044cffa63e9d26ed6ed3c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_a6f6d1cfd8044cffa63e9d26ed6ed3c7.jpg already downloaded
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F95%252F4a95321a42cbe5d1f4e272e615fea42c%252Fpa%252FWB66153_8dbfc401b524564251dcf0fda5fc10f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8dbfc401b524564251dcf0fda5fc10f2.jpg already downloaded
2026-03-30 12:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf082a5a-47a7-54bf-a9cf-fa53d72e6740, identifier: WB66153
2026-03-30 12:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf082a5a-47a7-54bf-a9cf-fa53d72e6740 with identifier: WB66153
2026-03-30 12:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf082a5a-47a7-54bf-a9cf-fa53d72e6740 with identifier: WB66153
2026-03-30 12:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf082a5a-47a7-54bf-a9cf-fa53d72e6740 with identifier: WB66153 to the API
2026-03-30 12:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB66153>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:46:47Z',
'fuel_type': 'diesel',
'id': 'bf082a5a-47a7-54bf-a9cf-fa53d72e6740',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB66153',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Porsche',
'model': 'Macan',
'odometer': 152607,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_aca078ec98228b4e5ed143076920d801.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_9d2b6553382d3578f2d6f15cd369cd0d.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8afb61165fce325bbe5fa4d25525895f.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7b8f3352ab2921113a7801ed98748bcf.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_6d555407b27781e8c67a16b295fca4a0.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_4d9db3bbed8219a07d2ba66dd885c559.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7a9cc95742c221c793e9db70cc75463f.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_c05a36bf9183855fb64b41b268f20d5c.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_a6f6d1cfd8044cffa63e9d26ed6ed3c7.jpg',
'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8dbfc401b524564251dcf0fda5fc10f2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_aca078ec98228b4e5ed143076920d801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_9d2b6553382d3578f2d6f15cd369cd0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8afb61165fce325bbe5fa4d25525895f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7b8f3352ab2921113a7801ed98748bcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_6d555407b27781e8c67a16b295fca4a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_4d9db3bbed8219a07d2ba66dd885c559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_7a9cc95742c221c793e9db70cc75463f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70765,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_c05a36bf9183855fb64b41b268f20d5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_a6f6d1cfd8044cffa63e9d26ed6ed3c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf082a5a-47a7-54bf-a9cf-fa53d72e6740/bf082a5a-47a7-54bf-a9cf-fa53d72e6740_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/95/4a95321a42cbe5d1f4e272e615fea42c/pa/WB66153_8dbfc401b524564251dcf0fda5fc10f2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB66153%27 HTTP/1.1" 200 None
2026-03-30 12:09:31 [auto1.fr] INFO: Saving data for WB66153: {'created_time': 1774872571.549596, 'last_price_update_time': 1774872571.549606, 'auction_closing_time': 1774972007.0}
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB66153') HTTP/1.1" 204 0
2026-03-30 12:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB24231> (referer: https://www.auto1.com/v1/car-details-view/PB24231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3862103-18af-57d4-a49d-25aea2bf171d with identifier: PB24231
2026-03-30 12:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3862103-18af-57d4-a49d-25aea2bf171d with scrape type 1
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3862103-18af-57d4-a49d-25aea2bf171d
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_5505d2f2d077d189f9a8450a28c5ef1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_5505d2f2d077d189f9a8450a28c5ef1c.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_8830c89631e94c379fa4cf73364c42e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8830c89631e94c379fa4cf73364c42e2.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_3f0ef23ceead75fb5514aba85f5dcdec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_3f0ef23ceead75fb5514aba85f5dcdec.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_50072bc2b7c9865696c1368398ec9a07.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_50072bc2b7c9865696c1368398ec9a07.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_7adc187a456dfc202341f1824279314e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_7adc187a456dfc202341f1824279314e.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_16381eb74839bdd3ca3db1180975a4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_16381eb74839bdd3ca3db1180975a4e0.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_0995110cb266bd94edc346d3db8b7a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_0995110cb266bd94edc346d3db8b7a06.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_c45bd3f8a1370599f759c673b126667b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_c45bd3f8a1370599f759c673b126667b.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_04124a704cbb7bc2ca7733493858f664.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_04124a704cbb7bc2ca7733493858f664.jpg already downloaded
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F09%252F750912809ec683528acf3c3e91963d17%252Fpa%252FPB24231_8e521cba70caf6f1a631d43cb46743cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8e521cba70caf6f1a631d43cb46743cd.jpg already downloaded
2026-03-30 12:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3862103-18af-57d4-a49d-25aea2bf171d, identifier: PB24231
2026-03-30 12:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3862103-18af-57d4-a49d-25aea2bf171d with identifier: PB24231
2026-03-30 12:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3862103-18af-57d4-a49d-25aea2bf171d with identifier: PB24231
2026-03-30 12:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3862103-18af-57d4-a49d-25aea2bf171d with identifier: PB24231 to the API
2026-03-30 12:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PB24231>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:10:34Z',
'fuel_type': 'diesel',
'id': 'e3862103-18af-57d4-a49d-25aea2bf171d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB24231',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'BMW',
'model': 'X1',
'odometer': 304790,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_5505d2f2d077d189f9a8450a28c5ef1c.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8830c89631e94c379fa4cf73364c42e2.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_3f0ef23ceead75fb5514aba85f5dcdec.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_50072bc2b7c9865696c1368398ec9a07.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_7adc187a456dfc202341f1824279314e.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_16381eb74839bdd3ca3db1180975a4e0.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_0995110cb266bd94edc346d3db8b7a06.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_c45bd3f8a1370599f759c673b126667b.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_04124a704cbb7bc2ca7733493858f664.jpg',
'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8e521cba70caf6f1a631d43cb46743cd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_5505d2f2d077d189f9a8450a28c5ef1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8830c89631e94c379fa4cf73364c42e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_3f0ef23ceead75fb5514aba85f5dcdec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_50072bc2b7c9865696c1368398ec9a07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_7adc187a456dfc202341f1824279314e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_16381eb74839bdd3ca3db1180975a4e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_0995110cb266bd94edc346d3db8b7a06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_c45bd3f8a1370599f759c673b126667b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_04124a704cbb7bc2ca7733493858f664.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3862103-18af-57d4-a49d-25aea2bf171d/e3862103-18af-57d4-a49d-25aea2bf171d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/09/750912809ec683528acf3c3e91963d17/pa/PB24231_8e521cba70caf6f1a631d43cb46743cd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 20d Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2011}
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB24231%27 HTTP/1.1" 200 None
2026-03-30 12:09:33 [auto1.fr] INFO: Saving data for PB24231: {'created_time': 1774872573.212838, 'last_price_update_time': 1774872573.212849, 'auction_closing_time': 1774969834.0}
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB24231') HTTP/1.1" 204 0
2026-03-30 12:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY82143> (referer: https://www.auto1.com/v1/car-details-view/SY82143/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf8c1e8-711d-5586-9ae7-066615c5b074 with identifier: SY82143
2026-03-30 12:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf8c1e8-711d-5586-9ae7-066615c5b074 with scrape type 1
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_501a59bdc60847a3cd747a3d8e90c583.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_501a59bdc60847a3cd747a3d8e90c583.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_4a285686766880a567b58e2459f8f918.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_4a285686766880a567b58e2459f8f918.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_879ad98949b244fbc7ebf5a8885817f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_879ad98949b244fbc7ebf5a8885817f8.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_5142e96d91fb126395ad29871bff7d7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_5142e96d91fb126395ad29871bff7d7f.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_611fb1021a8777e68b71048f90e70b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_611fb1021a8777e68b71048f90e70b06.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_a15287529fe2e926aacd362eceb1997e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_a15287529fe2e926aacd362eceb1997e.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_d3607320e0e90bb60872e17018788318.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_d3607320e0e90bb60872e17018788318.jpg not downloaded yet
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_13345d6b1200321a4584ce6e96749f65.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_13345d6b1200321a4584ce6e96749f65.jpg not downloaded yet
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.531(s), this was the 1st time calling it.
2026-03-30 12:09:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.951856657125639 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW99844/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_13345d6b1200321a4584ce6e96749f65.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_d3607320e0e90bb60872e17018788318.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513e150>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_13345d6b1200321a4584ce6e96749f65.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_13345d6b1200321a4584ce6e96749f65.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0f150>
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_d3607320e0e90bb60872e17018788318.jpg') HTTP/1.1" 204 0
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_d3607320e0e90bb60872e17018788318.jpg saved to cache
2026-03-30 12:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.499(s), this was the 1st time calling it.
2026-03-30 12:09:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.450210836231057 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:58 [scrapy.extensions.logstats] INFO: Crawled 171 pages (at 17 pages/min), scraped 155 items (at 10 items/min)
2026-03-30 12:09:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB91559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_a15287529fe2e926aacd362eceb1997e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d1090>
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_a15287529fe2e926aacd362eceb1997e.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_a15287529fe2e926aacd362eceb1997e.jpg saved to cache
2026-03-30 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c664d0>
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg saved to cache
2026-03-30 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY00599> (referer: https://www.auto1.com/v1/car-details-view/KY00599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_611fb1021a8777e68b71048f90e70b06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27830dca-a89f-575b-b988-e6fe73e3fcd9 with identifier: KY00599
2026-03-30 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27830dca-a89f-575b-b988-e6fe73e3fcd9 with scrape type 1
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_575478ca2d1e5d79489601d5b5ccde26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_575478ca2d1e5d79489601d5b5ccde26.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_f4479d818b2234748e7a228bd40deb34.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_f4479d818b2234748e7a228bd40deb34.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_acf91649c078ec6235703971ae32576e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_acf91649c078ec6235703971ae32576e.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg not downloaded yet
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0ce50>
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_611fb1021a8777e68b71048f90e70b06.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_611fb1021a8777e68b71048f90e70b06.jpg saved to cache
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_77102548ec626135e283f86a16cd3390.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_77102548ec626135e283f86a16cd3390.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_92db96d932d228d98c80499faa10e0dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_92db96d932d228d98c80499faa10e0dc.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg not downloaded yet
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg not downloaded yet
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_5142e96d91fb126395ad29871bff7d7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c1ce10>
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_5142e96d91fb126395ad29871bff7d7f.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_5142e96d91fb126395ad29871bff7d7f.jpg saved to cache
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_92db96d932d228d98c80499faa10e0dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1ff10>
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg saved to cache
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fea10>
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg saved to cache
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285109750>
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_92db96d932d228d98c80499faa10e0dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_92db96d932d228d98c80499faa10e0dc.jpg saved to cache
2026-03-30 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_77102548ec626135e283f86a16cd3390.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287ccc7d0>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_77102548ec626135e283f86a16cd3390.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_77102548ec626135e283f86a16cd3390.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b32a10>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_acf91649c078ec6235703971ae32576e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728510b690>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc6010>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_f4479d818b2234748e7a228bd40deb34.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b5f990>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_acf91649c078ec6235703971ae32576e.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_acf91649c078ec6235703971ae32576e.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_575478ca2d1e5d79489601d5b5ccde26.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc53d0>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_f4479d818b2234748e7a228bd40deb34.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_f4479d818b2234748e7a228bd40deb34.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_879ad98949b244fbc7ebf5a8885817f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aae950>
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252Fde%252F47de06795710f4981ed6f103c332101e%252Fpa%252FKY00599_575478ca2d1e5d79489601d5b5ccde26.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_575478ca2d1e5d79489601d5b5ccde26.jpg saved to cache
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27830dca-a89f-575b-b988-e6fe73e3fcd9
2026-03-30 12:10:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27830dca-a89f-575b-b988-e6fe73e3fcd9, skipping ID generation
2026-03-30 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27830dca-a89f-575b-b988-e6fe73e3fcd9 with scrape type 1
2026-03-30 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27830dca-a89f-575b-b988-e6fe73e3fcd9 sending to next pipeline
2026-03-30 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 27830dca-a89f-575b-b988-e6fe73e3fcd9, identifier: KY00599
2026-03-30 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27830dca-a89f-575b-b988-e6fe73e3fcd9 with identifier: KY00599
2026-03-30 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27830dca-a89f-575b-b988-e6fe73e3fcd9 with identifier: KY00599
2026-03-30 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27830dca-a89f-575b-b988-e6fe73e3fcd9 with identifier: KY00599 to the API
2026-03-30 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_575478ca2d1e5d79489601d5b5ccde26.jpg>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:41:56Z',
'fuel_type': 'diesel',
'id': '27830dca-a89f-575b-b988-e6fe73e3fcd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY00599',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 168818,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_575478ca2d1e5d79489601d5b5ccde26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_f4479d818b2234748e7a228bd40deb34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_acf91649c078ec6235703971ae32576e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_bdc3658c96f5985ca23a1da7c1b6b2e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3733a9c35b68b71848d7fcc6f4e6e4d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_e26bbaf2549d1a394e7329a10c492ce9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_77102548ec626135e283f86a16cd3390.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_92db96d932d228d98c80499faa10e0dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_c77d321c1dd6d87cb8a8883d45c58b94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27830dca-a89f-575b-b988-e6fe73e3fcd9/27830dca-a89f-575b-b988-e6fe73e3fcd9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img47/de/47de06795710f4981ed6f103c332101e/pa/KY00599_3c5b3890e7368e40cd9fed0dedb14122.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-05-11',
'seats_number': 3,
'seller_name': None,
'title': 'Fiat Ducato 2.0 JTD 115',
'transmission': 'manual',
'trim': '115',
'year': 2015}
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY00599%27 HTTP/1.1" 200 None
2026-03-30 12:10:25 [auto1.fr] INFO: Saving data for KY00599: {'created_time': 1774872625.136106, 'last_price_update_time': 1774872625.136115, 'auction_closing_time': 1774971716.0}
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY00599') HTTP/1.1" 204 0
2026-03-30 12:10:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.973(s), this was the 2nd time calling it.
2026-03-30 12:10:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.035471435986237 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aac390>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_879ad98949b244fbc7ebf5a8885817f8.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_879ad98949b244fbc7ebf5a8885817f8.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_4a285686766880a567b58e2459f8f918.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_501a59bdc60847a3cd747a3d8e90c583.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b30ed0>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_4a285686766880a567b58e2459f8f918.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_4a285686766880a567b58e2459f8f918.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b31c50>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_501a59bdc60847a3cd747a3d8e90c583.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_501a59bdc60847a3cd747a3d8e90c583.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a01a90>
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F56%252F9256871ccdda85597c79b9aafb7e8875%252Fpa%252FSY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg saved to cache
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edf8c1e8-711d-5586-9ae7-066615c5b074
2026-03-30 12:10:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edf8c1e8-711d-5586-9ae7-066615c5b074, skipping ID generation
2026-03-30 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf8c1e8-711d-5586-9ae7-066615c5b074 with scrape type 1
2026-03-30 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edf8c1e8-711d-5586-9ae7-066615c5b074 sending to next pipeline
2026-03-30 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: edf8c1e8-711d-5586-9ae7-066615c5b074, identifier: SY82143
2026-03-30 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: edf8c1e8-711d-5586-9ae7-066615c5b074 with identifier: SY82143
2026-03-30 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: edf8c1e8-711d-5586-9ae7-066615c5b074 with identifier: SY82143
2026-03-30 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: edf8c1e8-711d-5586-9ae7-066615c5b074 with identifier: SY82143 to the API
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:37:19Z',
'fuel_type': 'diesel',
'id': 'edf8c1e8-711d-5586-9ae7-066615c5b074',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY82143',
'listing': 'auction',
'location': 'FR, Wambrechies',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 218127,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_636eb815e8b85c3bec5bb8a7c5410cf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_501a59bdc60847a3cd747a3d8e90c583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657191,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_4a285686766880a567b58e2459f8f918.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_879ad98949b244fbc7ebf5a8885817f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2584493,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_5142e96d91fb126395ad29871bff7d7f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_611fb1021a8777e68b71048f90e70b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2662348,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_fc0efe49283ab7226850fea3b38ad7ac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_a15287529fe2e926aacd362eceb1997e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_d3607320e0e90bb60872e17018788318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf8c1e8-711d-5586-9ae7-066615c5b074/edf8c1e8-711d-5586-9ae7-066615c5b074_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/56/9256871ccdda85597c79b9aafb7e8875/pa/SY82143_13345d6b1200321a4584ce6e96749f65.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-05',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Intensive',
'transmission': 'manual',
'trim': 'Intensive',
'year': 2015}
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY82143%27 HTTP/1.1" 200 None
2026-03-30 12:10:26 [auto1.fr] INFO: Saving data for SY82143: {'created_time': 1774872626.063699, 'last_price_update_time': 1774872626.063711, 'auction_closing_time': 1774971439.0}
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SY82143') HTTP/1.1" 204 0
2026-03-30 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG93824> (referer: https://www.auto1.com/v1/car-details-view/CG93824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5570f8-e19f-5533-8bb1-778481e6982d with identifier: CG93824
2026-03-30 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5570f8-e19f-5533-8bb1-778481e6982d with scrape type 1
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_769ec7a47cf67107169ea17855b36a84.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_769ec7a47cf67107169ea17855b36a84.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_18e39461cc23851b7e75a48698b3334a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18e39461cc23851b7e75a48698b3334a.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_0ecaeed7a96c14951e635f4d6af26305.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_0ecaeed7a96c14951e635f4d6af26305.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_18bce997bd9fadd907dbe583f4def00a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18bce997bd9fadd907dbe583f4def00a.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_57453619ea147c266040f0da3ea4c497.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_57453619ea147c266040f0da3ea4c497.jpg not downloaded yet
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg not downloaded yet
2026-03-30 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER38330> (referer: https://www.auto1.com/v1/car-details-view/ER38330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with identifier: ER38330
2026-03-30 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with scrape type 1
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_3b70a683b479bf1a7e511800abab880b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_3b70a683b479bf1a7e511800abab880b.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_584b1afd25381cd70fc81287c62b12ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_584b1afd25381cd70fc81287c62b12ae.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_397116ce1d3388501caadc9d2f050ea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_397116ce1d3388501caadc9d2f050ea0.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_98305f7e37e3bcc30077bbaacbb47045.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_98305f7e37e3bcc30077bbaacbb47045.jpg not downloaded yet
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fe590>
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg saved to cache
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_a4238a885c717e93c11c0c0914b4f810.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_a4238a885c717e93c11c0c0914b4f810.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_8a7cc357f8861c42c7257089f637d197.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_8a7cc357f8861c42c7257089f637d197.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_57c1bb9d01b25a50628965ac06b24e48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_57c1bb9d01b25a50628965ac06b24e48.jpg not downloaded yet
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_57453619ea147c266040f0da3ea4c497.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg not downloaded yet
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_359eee6d31c41d722f1178d918ba93a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_359eee6d31c41d722f1178d918ba93a9.jpg not downloaded yet
2026-03-30 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB27239> (referer: https://www.auto1.com/v1/car-details-view/DB27239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac0b10>
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_57453619ea147c266040f0da3ea4c497.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_57453619ea147c266040f0da3ea4c497.jpg saved to cache
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4ef3af-f833-5787-a6b7-8fdc9d784ece with identifier: DB27239
2026-03-30 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4ef3af-f833-5787-a6b7-8fdc9d784ece with scrape type 1
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd4ef3af-f833-5787-a6b7-8fdc9d784ece
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_3b82dcfef2ff52fb1b2f651e57e91bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3b82dcfef2ff52fb1b2f651e57e91bad.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_f461b83758951c56bd2618c5699adeb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_f461b83758951c56bd2618c5699adeb8.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_be81bc66b765497268fb95d1d1aecb8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_be81bc66b765497268fb95d1d1aecb8d.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_09e0de0ec30cb8bfa3268b785b3ccbe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_09e0de0ec30cb8bfa3268b785b3ccbe7.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_82c7022f82e0116c195956de15580153.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_82c7022f82e0116c195956de15580153.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_3506ccc7625ee5b59f3756a29f693ccd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3506ccc7625ee5b59f3756a29f693ccd.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_3d8f2a912cad65393292dede14d50fdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3d8f2a912cad65393292dede14d50fdc.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_045d6d76fec53c3621e02c9559fa21f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_045d6d76fec53c3621e02c9559fa21f2.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_2ed05c845bc06ac4b06683874495f40f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_2ed05c845bc06ac4b06683874495f40f.jpg already downloaded
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F08%252Ffb08a27aa4e0bf02daf616f05c1eaca5%252Fpa%252FDB27239_8a35a107d004edc2f79e9d6ee1a8ae53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_8a35a107d004edc2f79e9d6ee1a8ae53.jpg already downloaded
2026-03-30 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd4ef3af-f833-5787-a6b7-8fdc9d784ece, identifier: DB27239
2026-03-30 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd4ef3af-f833-5787-a6b7-8fdc9d784ece with identifier: DB27239
2026-03-30 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd4ef3af-f833-5787-a6b7-8fdc9d784ece with identifier: DB27239
2026-03-30 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd4ef3af-f833-5787-a6b7-8fdc9d784ece with identifier: DB27239 to the API
2026-03-30 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB27239>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:10:51Z',
'fuel_type': 'diesel',
'id': 'bd4ef3af-f833-5787-a6b7-8fdc9d784ece',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB27239',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 232949,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3b82dcfef2ff52fb1b2f651e57e91bad.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_f461b83758951c56bd2618c5699adeb8.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_be81bc66b765497268fb95d1d1aecb8d.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_09e0de0ec30cb8bfa3268b785b3ccbe7.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_82c7022f82e0116c195956de15580153.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3506ccc7625ee5b59f3756a29f693ccd.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3d8f2a912cad65393292dede14d50fdc.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_045d6d76fec53c3621e02c9559fa21f2.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_2ed05c845bc06ac4b06683874495f40f.jpg',
'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_8a35a107d004edc2f79e9d6ee1a8ae53.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3b82dcfef2ff52fb1b2f651e57e91bad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_f461b83758951c56bd2618c5699adeb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_be81bc66b765497268fb95d1d1aecb8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_09e0de0ec30cb8bfa3268b785b3ccbe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_82c7022f82e0116c195956de15580153.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3506ccc7625ee5b59f3756a29f693ccd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_3d8f2a912cad65393292dede14d50fdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_045d6d76fec53c3621e02c9559fa21f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_2ed05c845bc06ac4b06683874495f40f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4ef3af-f833-5787-a6b7-8fdc9d784ece/bd4ef3af-f833-5787-a6b7-8fdc9d784ece_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/08/fb08a27aa4e0bf02daf616f05c1eaca5/pa/DB27239_8a35a107d004edc2f79e9d6ee1a8ae53.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-01',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2016}
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB27239%27 HTTP/1.1" 200 None
2026-03-30 12:10:38 [auto1.fr] INFO: Saving data for DB27239: {'created_time': 1774872638.377439, 'last_price_update_time': 1774872638.377451, 'auction_closing_time': 1774969851.0}
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB27239') HTTP/1.1" 204 0
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_359eee6d31c41d722f1178d918ba93a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_57c1bb9d01b25a50628965ac06b24e48.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR78024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_8a7cc357f8861c42c7257089f637d197.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a61810>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_359eee6d31c41d722f1178d918ba93a9.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_359eee6d31c41d722f1178d918ba93a9.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aac690>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_57c1bb9d01b25a50628965ac06b24e48.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_57c1bb9d01b25a50628965ac06b24e48.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c66a90>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_8a7cc357f8861c42c7257089f637d197.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_8a7cc357f8861c42c7257089f637d197.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_98305f7e37e3bcc30077bbaacbb47045.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b28510>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_a4238a885c717e93c11c0c0914b4f810.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850f1390>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_98305f7e37e3bcc30077bbaacbb47045.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_98305f7e37e3bcc30077bbaacbb47045.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_397116ce1d3388501caadc9d2f050ea0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514f710>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_a4238a885c717e93c11c0c0914b4f810.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_a4238a885c717e93c11c0c0914b4f810.jpg saved to cache
2026-03-30 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a11a90>
2026-03-30 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_397116ce1d3388501caadc9d2f050ea0.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_397116ce1d3388501caadc9d2f050ea0.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_3b70a683b479bf1a7e511800abab880b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850f3010>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_584b1afd25381cd70fc81287c62b12ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b08b90>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_3b70a683b479bf1a7e511800abab880b.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_3b70a683b479bf1a7e511800abab880b.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b32d10>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fa3%252Ffca387a8fb9065fd880f905930180553%252Fpa%252FER38330_584b1afd25381cd70fc81287c62b12ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_584b1afd25381cd70fc81287c62b12ae.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f
2026-03-30 12:10:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f, skipping ID generation
2026-03-30 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with scrape type 1
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f sending to next pipeline
2026-03-30 12:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f, identifier: ER38330
2026-03-30 12:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with identifier: ER38330
2026-03-30 12:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with identifier: ER38330
2026-03-30 12:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f with identifier: ER38330 to the API
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_584b1afd25381cd70fc81287c62b12ae.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:59:15Z',
'fuel_type': 'petrol',
'id': 'fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER38330',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Citroen',
'model': 'C3',
'odometer': 3782,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_3b70a683b479bf1a7e511800abab880b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_584b1afd25381cd70fc81287c62b12ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_397116ce1d3388501caadc9d2f050ea0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_d97a1c4b7d74afcf35907e2471d904e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_98305f7e37e3bcc30077bbaacbb47045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_a4238a885c717e93c11c0c0914b4f810.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_8a7cc357f8861c42c7257089f637d197.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_57c1bb9d01b25a50628965ac06b24e48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_c1d151809a2c1e0ab7eac44f6741748f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f/fb9b5cc4-58eb-5fab-a9df-45eb34f2c59f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/a3/fca387a8fb9065fd880f905930180553/pa/ER38330_359eee6d31c41d722f1178d918ba93a9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech YOU',
'transmission': 'manual',
'trim': 'YOU',
'year': 2022}
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER38330%27 HTTP/1.1" 200 None
2026-03-30 12:10:39 [auto1.fr] INFO: Saving data for ER38330: {'created_time': 1774872639.812752, 'last_price_update_time': 1774872639.812764, 'auction_closing_time': 1774972755.0}
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER38330') HTTP/1.1" 204 0
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18bce997bd9fadd907dbe583f4def00a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a12e90>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72851403d0>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg saved to cache
2026-03-30 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879ffc90>
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_18bce997bd9fadd907dbe583f4def00a.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18bce997bd9fadd907dbe583f4def00a.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a781d0>
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_0ecaeed7a96c14951e635f4d6af26305.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18e39461cc23851b7e75a48698b3334a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_769ec7a47cf67107169ea17855b36a84.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508eed0>
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_0ecaeed7a96c14951e635f4d6af26305.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_0ecaeed7a96c14951e635f4d6af26305.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf9950>
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_18e39461cc23851b7e75a48698b3334a.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18e39461cc23851b7e75a48698b3334a.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287a45d10>
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_769ec7a47cf67107169ea17855b36a84.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_769ec7a47cf67107169ea17855b36a84.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72868c6ed0>
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fd7%252F63d776ab89bd2da956a9741dfde12739%252Fpa%252FCG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg') HTTP/1.1" 204 0
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg saved to cache
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b5570f8-e19f-5533-8bb1-778481e6982d
2026-03-30 12:10:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b5570f8-e19f-5533-8bb1-778481e6982d, skipping ID generation
2026-03-30 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5570f8-e19f-5533-8bb1-778481e6982d with scrape type 1
2026-03-30 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b5570f8-e19f-5533-8bb1-778481e6982d sending to next pipeline
2026-03-30 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b5570f8-e19f-5533-8bb1-778481e6982d, identifier: CG93824
2026-03-30 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b5570f8-e19f-5533-8bb1-778481e6982d with identifier: CG93824
2026-03-30 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b5570f8-e19f-5533-8bb1-778481e6982d with identifier: CG93824
2026-03-30 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b5570f8-e19f-5533-8bb1-778481e6982d with identifier: CG93824 to the API
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:39:48Z',
'fuel_type': 'diesel',
'id': '1b5570f8-e19f-5533-8bb1-778481e6982d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG93824',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 166537,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_769ec7a47cf67107169ea17855b36a84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_c924d4f655bbd6a5a528db75e2e391e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18e39461cc23851b7e75a48698b3334a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_0ecaeed7a96c14951e635f4d6af26305.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_20b17ce8be3a8c42c599affef3f1e6c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_18bce997bd9fadd907dbe583f4def00a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d7a9d7ce966e8ff271abbd7baa473c6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_d894da258a050c48aadd1a78f9f5e7f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_57453619ea147c266040f0da3ea4c497.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b5570f8-e19f-5533-8bb1-778481e6982d/1b5570f8-e19f-5533-8bb1-778481e6982d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/d7/63d776ab89bd2da956a9741dfde12739/pa/CG93824_9dfeb67e0a726a2a2a059bdd53d65243.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-21',
'seats_number': 3,
'seller_name': None,
'title': 'Fiat Doblo 1.3 M-Jet Pack Pro Nav Fourgon',
'transmission': 'manual',
'trim': 'Pack Pro Nav Fourgon',
'year': 2019}
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG93824%27 HTTP/1.1" 200 None
2026-03-30 12:10:40 [auto1.fr] INFO: Saving data for CG93824: {'created_time': 1774872640.988389, 'last_price_update_time': 1774872640.988401, 'auction_closing_time': 1774971588.0}
2026-03-30 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CG93824') HTTP/1.1" 204 0
2026-03-30 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ22244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:49 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 5709 | hits on page: 40
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: JS02864
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: JE60275
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: TP56731
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: SL97840
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL97840%27 HTTP/1.1" 200 None
2026-03-30 12:10:49 [auto1.fr] INFO: Scrape type for SL97840: 0
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: UF15534
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: YT50077
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: NE75064
2026-03-30 12:10:49 [auto1.fr] INFO: Found listing with ID: HL20031
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL20031%27 HTTP/1.1" 200 None
2026-03-30 12:10:49 [auto1.fr] INFO: Scrape type for HL20031: 2
2026-03-30 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dfcce66-72b0-5e8e-858b-c45554b45d4b with identifier: HL20031
2026-03-30 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfcce66-72b0-5e8e-858b-c45554b45d4b with scrape type 2
2026-03-30 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dfcce66-72b0-5e8e-858b-c45554b45d4b with scrape type 2
2026-03-30 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0dfcce66-72b0-5e8e-858b-c45554b45d4b, identifier: HL20031
2026-03-30 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0dfcce66-72b0-5e8e-858b-c45554b45d4b with identifier: HL20031
2026-03-30 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0dfcce66-72b0-5e8e-858b-c45554b45d4b with identifier: HL20031
2026-03-30 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0dfcce66-72b0-5e8e-858b-c45554b45d4b with identifier: HL20031 to the API
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:15:51Z',
'fuel_type': 'diesel',
'id': '0dfcce66-72b0-5e8e-858b-c45554b45d4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL20031',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 135717,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-07',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL20031%27 HTTP/1.1" 200 None
2026-03-30 12:10:49 [auto1.fr] INFO: Saving data for HL20031: {'auction_closing_time': 1774970151.0, 'created_time': 1773078258.384395, 'last_price_update_time': 1774872649.894478}
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL20031') HTTP/1.1" 204 0
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: MC54002
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: VX18119
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX18119%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Scrape type for VX18119: 1
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: GG26646
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: TL75170
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: EA77824
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: CT12703
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: SU76987
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU76987%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Scrape type for SU76987: 1
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: NU85772
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: TU91399
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU91399%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Scrape type for TU91399: 1
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: LE79705
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: VV72434
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: CH43264
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH43264%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Scrape type for CH43264: 2
2026-03-30 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb8effe-a5db-53b0-9267-402d167fb7bb with identifier: CH43264
2026-03-30 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb8effe-a5db-53b0-9267-402d167fb7bb with scrape type 2
2026-03-30 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb8effe-a5db-53b0-9267-402d167fb7bb with scrape type 2
2026-03-30 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0fb8effe-a5db-53b0-9267-402d167fb7bb, identifier: CH43264
2026-03-30 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0fb8effe-a5db-53b0-9267-402d167fb7bb with identifier: CH43264
2026-03-30 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0fb8effe-a5db-53b0-9267-402d167fb7bb with identifier: CH43264
2026-03-30 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0fb8effe-a5db-53b0-9267-402d167fb7bb with identifier: CH43264 to the API
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:59:38Z',
'fuel_type': 'diesel',
'id': '0fb8effe-a5db-53b0-9267-402d167fb7bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH43264',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 154665,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-09',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Fourgon Business L1H1 FWD',
'transmission': 'manual',
'trim': 'Fourgon Business L1H1 FWD',
'year': 2021}
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH43264%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Saving data for CH43264: {'auction_closing_time': 1774972778.0, 'created_time': 1773937401.338308, 'last_price_update_time': 1774872650.489343}
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH43264') HTTP/1.1" 204 0
2026-03-30 12:10:50 [auto1.fr] INFO: Found listing with ID: CB36786
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB36786%27 HTTP/1.1" 200 None
2026-03-30 12:10:50 [auto1.fr] INFO: Scrape type for CB36786: 2
2026-03-30 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with identifier: CB36786
2026-03-30 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with scrape type 2
2026-03-30 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with scrape type 2
2026-03-30 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1, identifier: CB36786
2026-03-30 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with identifier: CB36786
2026-03-30 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with identifier: CB36786
2026-03-30 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1 with identifier: CB36786 to the API
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:16:06Z',
'fuel_type': 'diesel',
'id': '9f3cc36c-cb8f-5c56-b2d4-bae4ef7b8da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB36786',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 141079,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB36786%27 HTTP/1.1" 200 None
2026-03-30 12:10:51 [auto1.fr] INFO: Saving data for CB36786: {'auction_closing_time': 1774970166.0, 'created_time': 1774091513.45417, 'last_price_update_time': 1774872651.022267}
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB36786') HTTP/1.1" 204 0
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: RX13312
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: DK51089
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: PB02514
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: JF13819
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: EC34278
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: WF80383
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: SB53559
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: GG43203
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: NN21881
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: ET30983
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: JS22176
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: VS20220
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: TK02399
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: PH49145
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: ZE29063
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29063%27 HTTP/1.1" 200 None
2026-03-30 12:10:51 [auto1.fr] INFO: Scrape type for ZE29063: 2
2026-03-30 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29faee81-a8da-5320-8200-03ce70705c61 with identifier: ZE29063
2026-03-30 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29faee81-a8da-5320-8200-03ce70705c61 with scrape type 2
2026-03-30 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29faee81-a8da-5320-8200-03ce70705c61 with scrape type 2
2026-03-30 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29faee81-a8da-5320-8200-03ce70705c61, identifier: ZE29063
2026-03-30 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29faee81-a8da-5320-8200-03ce70705c61 with identifier: ZE29063
2026-03-30 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29faee81-a8da-5320-8200-03ce70705c61 with identifier: ZE29063
2026-03-30 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 29faee81-a8da-5320-8200-03ce70705c61 with identifier: ZE29063 to the API
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:17:09Z',
'fuel_type': 'diesel',
'id': '29faee81-a8da-5320-8200-03ce70705c61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE29063',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 118370,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seller_name': None,
'title': 'BMW 4er 425d Gran Coupé M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2016}
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29063%27 HTTP/1.1" 200 None
2026-03-30 12:10:51 [auto1.fr] INFO: Saving data for ZE29063: {'auction_closing_time': 1774970229.0, 'created_time': 1772816580.105585, 'last_price_update_time': 1774872651.513026}
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZE29063') HTTP/1.1" 204 0
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: ZV46129
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV46129%27 HTTP/1.1" 200 None
2026-03-30 12:10:51 [auto1.fr] INFO: Scrape type for ZV46129: 1
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: PM66643
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 12:10:51 [auto1.fr] INFO: Found listing with ID: XD68229
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD68229%27 HTTP/1.1" 200 None
2026-03-30 12:10:51 [auto1.fr] INFO: Scrape type for XD68229: 2
2026-03-30 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c429c7-4bd3-5118-81c5-20741112a880 with identifier: XD68229
2026-03-30 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c429c7-4bd3-5118-81c5-20741112a880 with scrape type 2
2026-03-30 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30c429c7-4bd3-5118-81c5-20741112a880 with scrape type 2
2026-03-30 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 30c429c7-4bd3-5118-81c5-20741112a880, identifier: XD68229
2026-03-30 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 30c429c7-4bd3-5118-81c5-20741112a880 with identifier: XD68229
2026-03-30 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 30c429c7-4bd3-5118-81c5-20741112a880 with identifier: XD68229
2026-03-30 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 30c429c7-4bd3-5118-81c5-20741112a880 with identifier: XD68229 to the API
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:30:49Z',
'fuel_type': 'diesel',
'id': '30c429c7-4bd3-5118-81c5-20741112a880',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD68229',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 167760,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-29',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'automatic',
'trim': 'Scout 4x4',
'year': 2019}
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD68229%27 HTTP/1.1" 200 None
2026-03-30 12:10:52 [auto1.fr] INFO: Saving data for XD68229: {'auction_closing_time': 1774971049.0, 'created_time': 1774267572.832081, 'last_price_update_time': 1774872652.081381}
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XD68229') HTTP/1.1" 204 0
2026-03-30 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV30142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB91559> (referer: https://www.auto1.com/v1/car-details-view/YB91559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edb132d2-e531-547f-838c-473e97e57de0 with identifier: YB91559
2026-03-30 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edb132d2-e531-547f-838c-473e97e57de0 with scrape type 1
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item edb132d2-e531-547f-838c-473e97e57de0
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_bc93030ce716a0f3a3b61485e3bab15c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bc93030ce716a0f3a3b61485e3bab15c.jpg already downloaded
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_dc61cb83d3c702ba8b5da5e0e1fa858f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_dc61cb83d3c702ba8b5da5e0e1fa858f.jpg already downloaded
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_bf98938aecd2cc00a6297ccc7702b801.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bf98938aecd2cc00a6297ccc7702b801.jpg already downloaded
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_97a2e5a08bec3fbded792ca5dd55def7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_97a2e5a08bec3fbded792ca5dd55def7.jpg already downloaded
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_8cdbd07f41328b08db479858a6c75f14.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_8cdbd07f41328b08db479858a6c75f14.jpg already downloaded
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F9d%252F9d9d767b09182792e89df566cbe56437%252Fpa%252FYB91559_14faafbf38fa0e9071430ebe4e8f15c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_14faafbf38fa0e9071430ebe4e8f15c8.jpg already downloaded
2026-03-30 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: edb132d2-e531-547f-838c-473e97e57de0, identifier: YB91559
2026-03-30 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: edb132d2-e531-547f-838c-473e97e57de0 with identifier: YB91559
2026-03-30 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: edb132d2-e531-547f-838c-473e97e57de0 with identifier: YB91559
2026-03-30 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: edb132d2-e531-547f-838c-473e97e57de0 with identifier: YB91559 to the API
2026-03-30 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB91559>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:42:38Z',
'fuel_type': 'petrol',
'id': 'edb132d2-e531-547f-838c-473e97e57de0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB91559',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Peugeot',
'model': '207',
'odometer': 137090,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bc93030ce716a0f3a3b61485e3bab15c.jpg',
'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_dc61cb83d3c702ba8b5da5e0e1fa858f.jpg',
'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bf98938aecd2cc00a6297ccc7702b801.jpg',
'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_97a2e5a08bec3fbded792ca5dd55def7.jpg',
'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_8cdbd07f41328b08db479858a6c75f14.jpg',
'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_14faafbf38fa0e9071430ebe4e8f15c8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bc93030ce716a0f3a3b61485e3bab15c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_dc61cb83d3c702ba8b5da5e0e1fa858f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_bf98938aecd2cc00a6297ccc7702b801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_97a2e5a08bec3fbded792ca5dd55def7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_8cdbd07f41328b08db479858a6c75f14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edb132d2-e531-547f-838c-473e97e57de0/edb132d2-e531-547f-838c-473e97e57de0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/9d/9d9d767b09182792e89df566cbe56437/pa/YB91559_14faafbf38fa0e9071430ebe4e8f15c8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2007}
2026-03-30 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB91559%27 HTTP/1.1" 200 None
2026-03-30 12:10:59 [auto1.fr] INFO: Saving data for YB91559: {'created_time': 1774872659.153246, 'last_price_update_time': 1774872659.153261, 'auction_closing_time': 1774971758.0}
2026-03-30 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB91559') HTTP/1.1" 204 0
2026-03-30 12:10:59 [scrapy.extensions.logstats] INFO: Crawled 181 pages (at 10 pages/min), scraped 166 items (at 11 items/min)
2026-03-30 12:10:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW99844> (referer: https://www.auto1.com/v1/car-details-view/EW99844/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac35238-16ff-5c0e-9ad4-796a00aa87d3 with identifier: EW99844
2026-03-30 12:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fac35238-16ff-5c0e-9ad4-796a00aa87d3 with scrape type 1
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fac35238-16ff-5c0e-9ad4-796a00aa87d3
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_de2149492b8503ae57073021a813c14b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_de2149492b8503ae57073021a813c14b.jpg already downloaded
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_ac0632df8cbdb10081245003f1542206.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_ac0632df8cbdb10081245003f1542206.jpg already downloaded
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_58c3b95a50c7b04d5bbd46e986798d4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_58c3b95a50c7b04d5bbd46e986798d4f.jpg already downloaded
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_23eb625d479f6f7e059552fd0382d4a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_23eb625d479f6f7e059552fd0382d4a6.jpg already downloaded
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_fed6d5a080114d08c61f2d24121d9882.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_fed6d5a080114d08c61f2d24121d9882.jpg already downloaded
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F04%252Fc10408ec66db1c224be2a0e85fa8b20f%252Fpa%252FEW99844_3a259e5bb6a874a59656db1d158ba772.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_3a259e5bb6a874a59656db1d158ba772.jpg already downloaded
2026-03-30 12:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fac35238-16ff-5c0e-9ad4-796a00aa87d3, identifier: EW99844
2026-03-30 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fac35238-16ff-5c0e-9ad4-796a00aa87d3 with identifier: EW99844
2026-03-30 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fac35238-16ff-5c0e-9ad4-796a00aa87d3 with identifier: EW99844
2026-03-30 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fac35238-16ff-5c0e-9ad4-796a00aa87d3 with identifier: EW99844 to the API
2026-03-30 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW99844>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:21:58Z',
'fuel_type': 'petrol',
'id': 'fac35238-16ff-5c0e-9ad4-796a00aa87d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW99844',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '208',
'odometer': 131677,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_de2149492b8503ae57073021a813c14b.jpg',
'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_ac0632df8cbdb10081245003f1542206.jpg',
'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_58c3b95a50c7b04d5bbd46e986798d4f.jpg',
'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_23eb625d479f6f7e059552fd0382d4a6.jpg',
'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_fed6d5a080114d08c61f2d24121d9882.jpg',
'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_3a259e5bb6a874a59656db1d158ba772.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_de2149492b8503ae57073021a813c14b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_ac0632df8cbdb10081245003f1542206.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_58c3b95a50c7b04d5bbd46e986798d4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_23eb625d479f6f7e059552fd0382d4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_fed6d5a080114d08c61f2d24121d9882.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac35238-16ff-5c0e-9ad4-796a00aa87d3/fac35238-16ff-5c0e-9ad4-796a00aa87d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/04/c10408ec66db1c224be2a0e85fa8b20f/pa/EW99844_3a259e5bb6a874a59656db1d158ba772.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-11-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2016}
2026-03-30 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW99844%27 HTTP/1.1" 200 None
2026-03-30 12:11:02 [auto1.fr] INFO: Saving data for EW99844: {'created_time': 1774872662.192123, 'last_price_update_time': 1774872662.192133, 'auction_closing_time': 1774970518.0}
2026-03-30 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW99844') HTTP/1.1" 204 0
2026-03-30 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS29137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR78024> (referer: https://www.auto1.com/v1/car-details-view/BR78024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81463c5b-b25b-58ee-adef-b55df7904aab with identifier: BR78024
2026-03-30 12:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81463c5b-b25b-58ee-adef-b55df7904aab with scrape type 1
2026-03-30 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_2170264ac98ed65117fb60826e0d74b7.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_2170264ac98ed65117fb60826e0d74b7.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_4ecbcec5a020dc0c3acab35dd739288e.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4ecbcec5a020dc0c3acab35dd739288e.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_343238b0bd3d7176113e12adcdc543a9.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_343238b0bd3d7176113e12adcdc543a9.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_8bfd2667aaeebecbec73909dafa73b46.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_8bfd2667aaeebecbec73909dafa73b46.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_76710f525be76c82a7895ea687c411dc.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_76710f525be76c82a7895ea687c411dc.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_0c17825c21734ce2b4d28d05f9a16205.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_0c17825c21734ce2b4d28d05f9a16205.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_83e3484a9d9af820ca5711461dc0dfd2.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_83e3484a9d9af820ca5711461dc0dfd2.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_4bb7489d26835717e1bb96ee98b16502.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4bb7489d26835717e1bb96ee98b16502.png not downloaded yet
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_a97225159866fb07cc41dfa262121a21.png%27 HTTP/1.1" 200 None
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_a97225159866fb07cc41dfa262121a21.png not downloaded yet
2026-03-30 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_2170264ac98ed65117fb60826e0d74b7.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285146b10>
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_0.png HTTP/1.1" 201 0
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_2170264ac98ed65117fb60826e0d74b7.png') HTTP/1.1" 204 0
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_2170264ac98ed65117fb60826e0d74b7.png saved to cache
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_a97225159866fb07cc41dfa262121a21.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c0e7d0>
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_9.png HTTP/1.1" 201 0
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_a97225159866fb07cc41dfa262121a21.png') HTTP/1.1" 204 0
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_a97225159866fb07cc41dfa262121a21.png saved to cache
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4bb7489d26835717e1bb96ee98b16502.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-03-30 12:11:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285abeed0>
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_8.png HTTP/1.1" 201 0
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_4bb7489d26835717e1bb96ee98b16502.png') HTTP/1.1" 204 0
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4bb7489d26835717e1bb96ee98b16502.png saved to cache
2026-03-30 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_83e3484a9d9af820ca5711461dc0dfd2.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_0c17825c21734ce2b4d28d05f9a16205.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c67010>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_7.png HTTP/1.1" 201 0
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_83e3484a9d9af820ca5711461dc0dfd2.png') HTTP/1.1" 204 0
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_83e3484a9d9af820ca5711461dc0dfd2.png saved to cache
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c677d0>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_6.png HTTP/1.1" 201 0
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_0c17825c21734ce2b4d28d05f9a16205.png') HTTP/1.1" 204 0
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_0c17825c21734ce2b4d28d05f9a16205.png saved to cache
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c24790>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_5.png HTTP/1.1" 201 0
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png') HTTP/1.1" 204 0
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png saved to cache
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_76710f525be76c82a7895ea687c411dc.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_8bfd2667aaeebecbec73909dafa73b46.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a06ad0>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_4.png HTTP/1.1" 201 0
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_76710f525be76c82a7895ea687c411dc.png') HTTP/1.1" 204 0
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_76710f525be76c82a7895ea687c411dc.png saved to cache
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d9d90>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_3.png HTTP/1.1" 201 0
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_8bfd2667aaeebecbec73909dafa73b46.png') HTTP/1.1" 204 0
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_8bfd2667aaeebecbec73909dafa73b46.png saved to cache
2026-03-30 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_343238b0bd3d7176113e12adcdc543a9.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:08 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a982d0>
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_2.png HTTP/1.1" 201 0
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_343238b0bd3d7176113e12adcdc543a9.png') HTTP/1.1" 204 0
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_343238b0bd3d7176113e12adcdc543a9.png saved to cache
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ22244> (referer: https://www.auto1.com/v1/car-details-view/FJ22244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4ecbcec5a020dc0c3acab35dd739288e.png> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0d105e-f10c-51da-946d-52902f226460 with identifier: FJ22244
2026-03-30 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0d105e-f10c-51da-946d-52902f226460 with scrape type 1
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg not downloaded yet
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_ca092c300f72518bff9ad30440370ed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_ca092c300f72518bff9ad30440370ed9.jpg not downloaded yet
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg not downloaded yet
2026-03-30 12:11:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 12:11:09 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 12:11:09 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72868c5d90>
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_1.png HTTP/1.1" 201 0
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fae%252F5dae5d5f6766a99b4df3406d0a3828fd%252Fpa%252FBR78024_4ecbcec5a020dc0c3acab35dd739288e.png') HTTP/1.1" 204 0
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4ecbcec5a020dc0c3acab35dd739288e.png saved to cache
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81463c5b-b25b-58ee-adef-b55df7904aab
2026-03-30 12:11:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81463c5b-b25b-58ee-adef-b55df7904aab, skipping ID generation
2026-03-30 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81463c5b-b25b-58ee-adef-b55df7904aab with scrape type 1
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81463c5b-b25b-58ee-adef-b55df7904aab sending to next pipeline
2026-03-30 12:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81463c5b-b25b-58ee-adef-b55df7904aab, identifier: BR78024
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg not downloaded yet
2026-03-30 12:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81463c5b-b25b-58ee-adef-b55df7904aab with identifier: BR78024
2026-03-30 12:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81463c5b-b25b-58ee-adef-b55df7904aab with identifier: BR78024
2026-03-30 12:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81463c5b-b25b-58ee-adef-b55df7904aab with identifier: BR78024 to the API
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4ecbcec5a020dc0c3acab35dd739288e.png>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:42:20Z',
'fuel_type': 'petrol',
'id': '81463c5b-b25b-58ee-adef-b55df7904aab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR78024',
'listing': 'auction',
'location': 'FR',
'make': 'Fiat',
'model': '500',
'odometer': 3232,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_0.png',
'Extension': 'png',
'FileSizeInBytes': 1052237,
'Height': 585,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_2170264ac98ed65117fb60826e0d74b7.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4ecbcec5a020dc0c3acab35dd739288e.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 1021636,
'Height': 588,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_343238b0bd3d7176113e12adcdc543a9.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_8bfd2667aaeebecbec73909dafa73b46.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 1168813,
'Height': 593,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_76710f525be76c82a7895ea687c411dc.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 1085861,
'Height': 585,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_ce7ae8db5e44a3687c7a684cf61a55a6.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 153288,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_0c17825c21734ce2b4d28d05f9a16205.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_83e3484a9d9af820ca5711461dc0dfd2.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 691368,
'Height': 596,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_4bb7489d26835717e1bb96ee98b16502.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81463c5b-b25b-58ee-adef-b55df7904aab/81463c5b-b25b-58ee-adef-b55df7904aab_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 566054,
'Height': 546,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ae/5dae5d5f6766a99b4df3406d0a3828fd/pa/BR78024_a97225159866fb07cc41dfa262121a21.png',
'Width': 727}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-23',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR78024%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [auto1.fr] INFO: Saving data for BR78024: {'created_time': 1774872669.809186, 'last_price_update_time': 1774872669.809196, 'auction_closing_time': 1774971740.0}
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR78024') HTTP/1.1" 204 0
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_d0ec933f38119fded8ea09344b60afdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_d0ec933f38119fded8ea09344b60afdd.jpg not downloaded yet
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg not downloaded yet
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_ca092c300f72518bff9ad30440370ed9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_d0ec933f38119fded8ea09344b60afdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c0bad0>
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg saved to cache
2026-03-30 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a33dd0>
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_ca092c300f72518bff9ad30440370ed9.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_ca092c300f72518bff9ad30440370ed9.jpg saved to cache
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c67650>
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg saved to cache
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508ff10>
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_d0ec933f38119fded8ea09344b60afdd.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_d0ec933f38119fded8ea09344b60afdd.jpg saved to cache
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b09810>
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg saved to cache
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a9a6d0>
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252F7b%252F457b555233933e973d926d30fc1ddcaf%252Fpa%252FFJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg saved to cache
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c0d105e-f10c-51da-946d-52902f226460
2026-03-30 12:11:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c0d105e-f10c-51da-946d-52902f226460, skipping ID generation
2026-03-30 12:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0d105e-f10c-51da-946d-52902f226460 with scrape type 1
2026-03-30 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c0d105e-f10c-51da-946d-52902f226460 sending to next pipeline
2026-03-30 12:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9c0d105e-f10c-51da-946d-52902f226460, identifier: FJ22244
2026-03-30 12:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9c0d105e-f10c-51da-946d-52902f226460 with identifier: FJ22244
2026-03-30 12:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9c0d105e-f10c-51da-946d-52902f226460 with identifier: FJ22244
2026-03-30 12:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9c0d105e-f10c-51da-946d-52902f226460 with identifier: FJ22244 to the API
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:29:44Z',
'fuel_type': 'diesel',
'id': '9c0d105e-f10c-51da-946d-52902f226460',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ22244',
'listing': 'auction',
'location': 'FR, Bourgoin Jallieu',
'make': 'Renault',
'model': 'Clio',
'odometer': 246914,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26f7ff329dd47b2c05a25ea0e8b1e44f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_ca092c300f72518bff9ad30440370ed9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_26edc18b343f9b598c0e7618fd511b4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_47fac2356ea6261d0d4b9d337cff4a99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_d0ec933f38119fded8ea09344b60afdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c0d105e-f10c-51da-946d-52902f226460/9c0d105e-f10c-51da-946d-52902f226460_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/7b/457b555233933e973d926d30fc1ddcaf/pa/FJ22244_9fc012f0f806c8a4897ec3f0ad290bdf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Campus.com',
'transmission': 'manual',
'trim': 'Campus.com',
'year': 2010}
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ22244%27 HTTP/1.1" 200 None
2026-03-30 12:11:10 [auto1.fr] INFO: Saving data for FJ22244: {'created_time': 1774872670.640396, 'last_price_update_time': 1774872670.640409, 'auction_closing_time': 1774970984.0}
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ22244') HTTP/1.1" 204 0
2026-03-30 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW25296/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.420(s), this was the 1st time calling it.
2026-03-30 12:11:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.094865502553395 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:16 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 5711 | hits on page: 40
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: XD68229
2026-03-30 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD68229%27 HTTP/1.1" 200 None
2026-03-30 12:11:16 [auto1.fr] INFO: Scrape type for XD68229: 0
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: LS37547
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: YH14839
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: RK82051
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: YL06097
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: SK43844
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: FX27811
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: CT78208
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: VT90507
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: KH76929
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: AN07347
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: HB98578
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: RH39246
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: PY51333
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: UA06834
2026-03-30 12:11:16 [auto1.fr] INFO: Found listing with ID: JV30331
2026-03-30 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV30331%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for JV30331: 1
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: LM24341
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: VB98867
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: YC82706
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: EP61316
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: JY39287
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY39287%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for JY39287: 1
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: LJ73279
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: PU36088
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: TE38674
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: WV33218
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX44661%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for AX44661: 1
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: JC65585
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: UZ77285
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: CK52934
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: RN04117
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: KK86719
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: XE90293
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: XK60858
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK90801%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for UK90801: 0
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE89724%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for RE89724: 1
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD81431%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Scrape type for VD81431: 2
2026-03-30 12:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff00c172-0984-51b6-a13f-03b7dc6dd2ce with identifier: VD81431
2026-03-30 12:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff00c172-0984-51b6-a13f-03b7dc6dd2ce with scrape type 2
2026-03-30 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff00c172-0984-51b6-a13f-03b7dc6dd2ce with scrape type 2
2026-03-30 12:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff00c172-0984-51b6-a13f-03b7dc6dd2ce, identifier: VD81431
2026-03-30 12:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff00c172-0984-51b6-a13f-03b7dc6dd2ce with identifier: VD81431
2026-03-30 12:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff00c172-0984-51b6-a13f-03b7dc6dd2ce with identifier: VD81431
2026-03-30 12:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff00c172-0984-51b6-a13f-03b7dc6dd2ce with identifier: VD81431 to the API
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:29:55Z',
'fuel_type': 'diesel',
'id': 'ff00c172-0984-51b6-a13f-03b7dc6dd2ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD81431',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 200105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-06',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2017}
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD81431%27 HTTP/1.1" 200 None
2026-03-30 12:11:17 [auto1.fr] INFO: Saving data for VD81431: {'auction_closing_time': 1774970995.0, 'created_time': 1774253451.77576, 'last_price_update_time': 1774872677.558342}
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VD81431') HTTP/1.1" 204 0
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 12:11:17 [auto1.fr] INFO: Found listing with ID: YU78646
2026-03-30 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:11:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.812(s), this was the 1st time calling it.
2026-03-30 12:11:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9036120665502287 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB23264> (referer: https://www.auto1.com/v1/car-details-view/AB23264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85e66ae-bc19-5edb-9749-3b3225b44404 with identifier: AB23264
2026-03-30 12:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85e66ae-bc19-5edb-9749-3b3225b44404 with scrape type 1
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e85e66ae-bc19-5edb-9749-3b3225b44404
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_6b86d14164a14c84b71a2dc1eff75b23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6b86d14164a14c84b71a2dc1eff75b23.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_c58c32f5eb361f8bd59b1ac693d283cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c58c32f5eb361f8bd59b1ac693d283cf.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_aa0c7c9d6bd2a16eb79dcd6a472f7848.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_aa0c7c9d6bd2a16eb79dcd6a472f7848.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_909f61ede1613f354d00eb1afe5453ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_909f61ede1613f354d00eb1afe5453ae.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_446317318dcdb74b17a890dc6f51815c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_446317318dcdb74b17a890dc6f51815c.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_a8a58c3c8b213cd88d27a94f40266fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_a8a58c3c8b213cd88d27a94f40266fc0.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_6eaf1d9f3549694e537dfbfb605a8b00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6eaf1d9f3549694e537dfbfb605a8b00.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_b29a1b4689e8f5c4cb85029f8724c64f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_b29a1b4689e8f5c4cb85029f8724c64f.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_85edab1de1695d9859edbf1a108d56e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_85edab1de1695d9859edbf1a108d56e6.jpg already downloaded
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F70%252F7e70b9c08ecad2e035c7d0fc5d27f7c3%252Fpa%252FAB23264_c5948377649707ef1f44081ce6b45db2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c5948377649707ef1f44081ce6b45db2.jpg already downloaded
2026-03-30 12:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e85e66ae-bc19-5edb-9749-3b3225b44404, identifier: AB23264
2026-03-30 12:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e85e66ae-bc19-5edb-9749-3b3225b44404 with identifier: AB23264
2026-03-30 12:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e85e66ae-bc19-5edb-9749-3b3225b44404 with identifier: AB23264
2026-03-30 12:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e85e66ae-bc19-5edb-9749-3b3225b44404 with identifier: AB23264 to the API
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB23264>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:23:35Z',
'fuel_type': 'petrol',
'id': 'e85e66ae-bc19-5edb-9749-3b3225b44404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB23264',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 207436,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6b86d14164a14c84b71a2dc1eff75b23.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c58c32f5eb361f8bd59b1ac693d283cf.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_aa0c7c9d6bd2a16eb79dcd6a472f7848.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_909f61ede1613f354d00eb1afe5453ae.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_446317318dcdb74b17a890dc6f51815c.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_a8a58c3c8b213cd88d27a94f40266fc0.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6eaf1d9f3549694e537dfbfb605a8b00.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_b29a1b4689e8f5c4cb85029f8724c64f.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_85edab1de1695d9859edbf1a108d56e6.jpg',
'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c5948377649707ef1f44081ce6b45db2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6b86d14164a14c84b71a2dc1eff75b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c58c32f5eb361f8bd59b1ac693d283cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_aa0c7c9d6bd2a16eb79dcd6a472f7848.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_909f61ede1613f354d00eb1afe5453ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_446317318dcdb74b17a890dc6f51815c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_a8a58c3c8b213cd88d27a94f40266fc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_6eaf1d9f3549694e537dfbfb605a8b00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_b29a1b4689e8f5c4cb85029f8724c64f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_85edab1de1695d9859edbf1a108d56e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85e66ae-bc19-5edb-9749-3b3225b44404/e85e66ae-bc19-5edb-9749-3b3225b44404_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/70/7e70b9c08ecad2e035c7d0fc5d27f7c3/pa/AB23264_c5948377649707ef1f44081ce6b45db2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI ACT Carat BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Carat BlueMotion Tech.',
'year': 2015}
2026-03-30 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB23264%27 HTTP/1.1" 200 None
2026-03-30 12:11:38 [auto1.fr] INFO: Saving data for AB23264: {'created_time': 1774872698.004995, 'last_price_update_time': 1774872698.005005, 'auction_closing_time': 1774970615.0}
2026-03-30 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB23264') HTTP/1.1" 204 0
2026-03-30 12:11:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.197(s), this was the 1st time calling it.
2026-03-30 12:11:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.116634741019153 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:11:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS02864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV30142> (referer: https://www.auto1.com/v1/car-details-view/FV30142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 436b3596-7c7f-5efe-bd0f-de298a242fa8 with identifier: FV30142
2026-03-30 12:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 436b3596-7c7f-5efe-bd0f-de298a242fa8 with scrape type 1
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 436b3596-7c7f-5efe-bd0f-de298a242fa8
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_adac5d8c19e26e864232e5ce7c36f2f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_adac5d8c19e26e864232e5ce7c36f2f4.jpg already downloaded
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_44e566773b83663df556754c2c389928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_44e566773b83663df556754c2c389928.jpg already downloaded
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_7d273d01b56a178edfd03ebce9fb311e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_7d273d01b56a178edfd03ebce9fb311e.jpg already downloaded
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_74484f82c8ff3f94c196874db15dab56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_74484f82c8ff3f94c196874db15dab56.jpg already downloaded
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_9494a1884d0532a29a6ec9601031dc22.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_9494a1884d0532a29a6ec9601031dc22.jpg already downloaded
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Ffd%252F5afd7f9a2d872e9cf26861e35f4d76b7%252Fpa%252FFV30142_2281403d2c7097d0d1c0660c1f11f220.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_2281403d2c7097d0d1c0660c1f11f220.jpg already downloaded
2026-03-30 12:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 436b3596-7c7f-5efe-bd0f-de298a242fa8, identifier: FV30142
2026-03-30 12:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 436b3596-7c7f-5efe-bd0f-de298a242fa8 with identifier: FV30142
2026-03-30 12:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 436b3596-7c7f-5efe-bd0f-de298a242fa8 with identifier: FV30142
2026-03-30 12:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 436b3596-7c7f-5efe-bd0f-de298a242fa8 with identifier: FV30142 to the API
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV30142>
{'auction_title': '',
'c_o_2_emission_value': 178,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:00:41Z',
'fuel_type': 'petrol',
'id': '436b3596-7c7f-5efe-bd0f-de298a242fa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV30142',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '307',
'odometer': 145148,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_adac5d8c19e26e864232e5ce7c36f2f4.jpg',
'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_44e566773b83663df556754c2c389928.jpg',
'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_7d273d01b56a178edfd03ebce9fb311e.jpg',
'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_74484f82c8ff3f94c196874db15dab56.jpg',
'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_9494a1884d0532a29a6ec9601031dc22.jpg',
'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_2281403d2c7097d0d1c0660c1f11f220.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_adac5d8c19e26e864232e5ce7c36f2f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_44e566773b83663df556754c2c389928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_7d273d01b56a178edfd03ebce9fb311e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_74484f82c8ff3f94c196874db15dab56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_9494a1884d0532a29a6ec9601031dc22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_436b3596-7c7f-5efe-bd0f-de298a242fa8/436b3596-7c7f-5efe-bd0f-de298a242fa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/fd/5afd7f9a2d872e9cf26861e35f4d76b7/pa/FV30142_2281403d2c7097d0d1c0660c1f11f220.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 307 1.6 SW Sport',
'transmission': 'manual',
'trim': 'SW Sport',
'year': 2006}
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV30142%27 HTTP/1.1" 200 None
2026-03-30 12:11:51 [auto1.fr] INFO: Saving data for FV30142: {'created_time': 1774872711.515064, 'last_price_update_time': 1774872711.515074, 'auction_closing_time': 1774969241.0}
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV30142') HTTP/1.1" 204 0
2026-03-30 12:11:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.349(s), this was the 1st time calling it.
2026-03-30 12:11:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.133547722701174 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:11:58 [scrapy.extensions.logstats] INFO: Crawled 190 pages (at 9 pages/min), scraped 172 items (at 6 items/min)
2026-03-30 12:11:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU91399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ04122> (referer: https://www.auto1.com/v1/car-details-view/GZ04122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0724a25b-9075-5bd5-80c8-a20fc48efa76 with identifier: GZ04122
2026-03-30 12:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0724a25b-9075-5bd5-80c8-a20fc48efa76 with scrape type 1
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_55e64d07be5c49ed9cd664814887e15d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_55e64d07be5c49ed9cd664814887e15d.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_ecd4958e7f3738498c63499b435596f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_ecd4958e7f3738498c63499b435596f4.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_2ead764adf26eb272811ccc5353a549e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_2ead764adf26eb272811ccc5353a549e.jpg not downloaded yet
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg not downloaded yet
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg not downloaded yet
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_1989cf748059902fabf180ed7f4b7458.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_1989cf748059902fabf180ed7f4b7458.jpg not downloaded yet
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg not downloaded yet
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285078110>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_1989cf748059902fabf180ed7f4b7458.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b30b50>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfc6d0>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_1989cf748059902fabf180ed7f4b7458.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_1989cf748059902fabf180ed7f4b7458.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a32f10>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_2ead764adf26eb272811ccc5353a549e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850da250>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_ecd4958e7f3738498c63499b435596f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a316d0>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_2ead764adf26eb272811ccc5353a549e.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_2ead764adf26eb272811ccc5353a549e.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_55e64d07be5c49ed9cd664814887e15d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508ffd0>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_ecd4958e7f3738498c63499b435596f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_ecd4958e7f3738498c63499b435596f4.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285146790>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_55e64d07be5c49ed9cd664814887e15d.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_55e64d07be5c49ed9cd664814887e15d.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a98710>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728515a010>
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Feb%252F0feba9182d5d7096b80c351d0b823758%252Fpa%252FGZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg') HTTP/1.1" 204 0
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg saved to cache
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0724a25b-9075-5bd5-80c8-a20fc48efa76
2026-03-30 12:12:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0724a25b-9075-5bd5-80c8-a20fc48efa76, skipping ID generation
2026-03-30 12:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0724a25b-9075-5bd5-80c8-a20fc48efa76 with scrape type 1
2026-03-30 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0724a25b-9075-5bd5-80c8-a20fc48efa76 sending to next pipeline
2026-03-30 12:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0724a25b-9075-5bd5-80c8-a20fc48efa76, identifier: GZ04122
2026-03-30 12:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0724a25b-9075-5bd5-80c8-a20fc48efa76 with identifier: GZ04122
2026-03-30 12:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0724a25b-9075-5bd5-80c8-a20fc48efa76 with identifier: GZ04122
2026-03-30 12:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0724a25b-9075-5bd5-80c8-a20fc48efa76 with identifier: GZ04122 to the API
2026-03-30 12:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:38:05Z',
'fuel_type': 'petrol',
'id': '0724a25b-9075-5bd5-80c8-a20fc48efa76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ04122',
'listing': 'auction',
'location': 'FR, Bourg-en-Bresse',
'make': 'Citroen',
'model': 'C3',
'odometer': 118345,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_bfa4110b8252cb637aac3eb871bdcfe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_52172bae6f6b15b61d5f65d1fdf0bc7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_4c5b9456a1e827347c254e17ff2cd4ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_55e64d07be5c49ed9cd664814887e15d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_ecd4958e7f3738498c63499b435596f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_2ead764adf26eb272811ccc5353a549e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5ecd63d83e268855e205a373c0d6acc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_5e17d0ecb78a55798615665c48bd23bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_1989cf748059902fabf180ed7f4b7458.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0724a25b-9075-5bd5-80c8-a20fc48efa76/0724a25b-9075-5bd5-80c8-a20fc48efa76_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0f/eb/0feba9182d5d7096b80c351d0b823758/pa/GZ04122_41a912d118468ff3c5e0af0e7c12125c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2017}
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ04122%27 HTTP/1.1" 200 None
2026-03-30 12:12:06 [auto1.fr] INFO: Saving data for GZ04122: {'created_time': 1774872726.636399, 'last_price_update_time': 1774872726.636413, 'auction_closing_time': 1774971485.0}
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ04122') HTTP/1.1" 204 0
2026-03-30 12:12:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.507(s), this was the 1st time calling it.
2026-03-30 12:12:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.826126163847432 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:58 [scrapy.extensions.logstats] INFO: Crawled 192 pages (at 2 pages/min), scraped 173 items (at 1 items/min)
2026-03-30 12:12:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:13:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.058(s), this was the 1st time calling it.
2026-03-30 12:13:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.44666615106662 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD64881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.355(s), this was the 1st time calling it.
2026-03-30 12:13:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.43271377757374 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.044(s), this was the 1st time calling it.
2026-03-30 12:13:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.587645301948069 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.588(s), this was the 2nd time calling it.
2026-03-30 12:13:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.3408436800646903 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX18119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC27609> (referer: https://www.auto1.com/v1/car-details-view/MC27609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922f0eea-a4c0-573c-be1c-5dff227b5e35 with identifier: MC27609
2026-03-30 12:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922f0eea-a4c0-573c-be1c-5dff227b5e35 with scrape type 1
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg not downloaded yet
2026-03-30 12:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_73cb02c037b549ef484f8c8190515d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_73cb02c037b549ef484f8c8190515d71.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_a03833f164b9bc2051243f6f4aeebf69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a03833f164b9bc2051243f6f4aeebf69.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_6048f1d344a6aede93a05512b91b9972.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_6048f1d344a6aede93a05512b91b9972.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_41564c93adc8f4cb9c494fced051c343.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_41564c93adc8f4cb9c494fced051c343.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg not downloaded yet
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_713e390045e503e4778654b2a1db96bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_713e390045e503e4778654b2a1db96bc.jpg not downloaded yet
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_73cb02c037b549ef484f8c8190515d71.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_713e390045e503e4778654b2a1db96bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_41564c93adc8f4cb9c494fced051c343.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a79a90>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_73cb02c037b549ef484f8c8190515d71.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_73cb02c037b549ef484f8c8190515d71.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c09290>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_6048f1d344a6aede93a05512b91b9972.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfd650>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_713e390045e503e4778654b2a1db96bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_713e390045e503e4778654b2a1db96bc.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287ccbb10>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285118290>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_41564c93adc8f4cb9c494fced051c343.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_41564c93adc8f4cb9c494fced051c343.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287d77810>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a03833f164b9bc2051243f6f4aeebf69.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d8350>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_6048f1d344a6aede93a05512b91b9972.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_6048f1d344a6aede93a05512b91b9972.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0e150>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV30331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850aa2d0>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_a03833f164b9bc2051243f6f4aeebf69.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a03833f164b9bc2051243f6f4aeebf69.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0eb10>
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fea%252F8bea20bdb9041696f3b4caa44a68d2ef%252Fpa%252FMC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg saved to cache
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 922f0eea-a4c0-573c-be1c-5dff227b5e35
2026-03-30 12:13:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 922f0eea-a4c0-573c-be1c-5dff227b5e35, skipping ID generation
2026-03-30 12:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922f0eea-a4c0-573c-be1c-5dff227b5e35 with scrape type 1
2026-03-30 12:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 922f0eea-a4c0-573c-be1c-5dff227b5e35 sending to next pipeline
2026-03-30 12:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 922f0eea-a4c0-573c-be1c-5dff227b5e35, identifier: MC27609
2026-03-30 12:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 922f0eea-a4c0-573c-be1c-5dff227b5e35 with identifier: MC27609
2026-03-30 12:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 922f0eea-a4c0-573c-be1c-5dff227b5e35 with identifier: MC27609
2026-03-30 12:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 922f0eea-a4c0-573c-be1c-5dff227b5e35 with identifier: MC27609 to the API
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 283,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:52:53Z',
'fuel_type': 'diesel',
'id': '922f0eea-a4c0-573c-be1c-5dff227b5e35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC27609',
'listing': 'auction',
'location': 'FR, Montévrain',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 287294,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_dfe5caae76f073d2cfda75e2b3e8b163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_73cb02c037b549ef484f8c8190515d71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_80666d4e7bd917806b6e96eccd7be4d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a03833f164b9bc2051243f6f4aeebf69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_f59e300a78e937ad8f4c1f6ad0ea8063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_6048f1d344a6aede93a05512b91b9972.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_41564c93adc8f4cb9c494fced051c343.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_a1b0eb8c72bca3313372bf0ad4148336.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_0f7dce0d75f408cbf06b3b1235b3f652.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_922f0eea-a4c0-573c-be1c-5dff227b5e35/922f0eea-a4c0-573c-be1c-5dff227b5e35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/ea/8bea20bdb9041696f3b4caa44a68d2ef/pa/MC27609_713e390045e503e4778654b2a1db96bc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI Carat Edition',
'transmission': 'automatic',
'trim': 'Carat Edition',
'year': 2007}
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC27609%27 HTTP/1.1" 200 None
2026-03-30 12:13:46 [auto1.fr] INFO: Saving data for MC27609: {'created_time': 1774872826.384638, 'last_price_update_time': 1774872826.38465, 'auction_closing_time': 1774972373.0}
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC27609') HTTP/1.1" 204 0
2026-03-30 12:13:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.143(s), this was the 1st time calling it.
2026-03-30 12:13:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.132308007015792 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU76987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX44661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC36158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV46129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY39287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS02864> (referer: https://www.auto1.com/v1/car-details-view/JS02864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f132b5-f0fe-511a-b86e-853d24b43e08 with identifier: JS02864
2026-03-30 12:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f132b5-f0fe-511a-b86e-853d24b43e08 with scrape type 1
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_404dda914bf2b566d9de209c85f268dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_404dda914bf2b566d9de209c85f268dc.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_c4ca85934940789ba99a2e488339f04c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_c4ca85934940789ba99a2e488339f04c.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_56ad353516292b48643fc8a648f11472.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_56ad353516292b48643fc8a648f11472.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg not downloaded yet
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_e372def725ba66a527fd1fbeecad8f46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_e372def725ba66a527fd1fbeecad8f46.jpg not downloaded yet
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_404dda914bf2b566d9de209c85f268dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg not downloaded yet
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_ceba2b033d132ccdfec542501066709d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_ceba2b033d132ccdfec542501066709d.jpg not downloaded yet
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfc590>
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg saved to cache
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_ceba2b033d132ccdfec542501066709d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285157b50>
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_404dda914bf2b566d9de209c85f268dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_404dda914bf2b566d9de209c85f268dc.jpg saved to cache
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_c4ca85934940789ba99a2e488339f04c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_e372def725ba66a527fd1fbeecad8f46.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b6e10>
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg saved to cache
2026-03-30 12:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_56ad353516292b48643fc8a648f11472.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dfc50>
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c368d0>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850abc90>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_ceba2b033d132ccdfec542501066709d.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_ceba2b033d132ccdfec542501066709d.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c04290>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_c4ca85934940789ba99a2e488339f04c.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_c4ca85934940789ba99a2e488339f04c.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850ab490>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_e372def725ba66a527fd1fbeecad8f46.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_e372def725ba66a527fd1fbeecad8f46.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0ea90>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_56ad353516292b48643fc8a648f11472.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_56ad353516292b48643fc8a648f11472.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285119910>
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F4f%252Ff84fb2cf698b836aa3a3b5876f500820%252Fpa%252FJS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg saved to cache
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12f132b5-f0fe-511a-b86e-853d24b43e08
2026-03-30 12:13:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12f132b5-f0fe-511a-b86e-853d24b43e08, skipping ID generation
2026-03-30 12:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f132b5-f0fe-511a-b86e-853d24b43e08 with scrape type 1
2026-03-30 12:13:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12f132b5-f0fe-511a-b86e-853d24b43e08 sending to next pipeline
2026-03-30 12:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12f132b5-f0fe-511a-b86e-853d24b43e08, identifier: JS02864
2026-03-30 12:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12f132b5-f0fe-511a-b86e-853d24b43e08 with identifier: JS02864
2026-03-30 12:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12f132b5-f0fe-511a-b86e-853d24b43e08 with identifier: JS02864
2026-03-30 12:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12f132b5-f0fe-511a-b86e-853d24b43e08 with identifier: JS02864 to the API
2026-03-30 12:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:18:52Z',
'fuel_type': 'petrol',
'id': '12f132b5-f0fe-511a-b86e-853d24b43e08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS02864',
'listing': 'auction',
'location': 'FR, Camon',
'make': 'Skoda',
'model': 'Scala',
'odometer': 56211,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_38ffe493bd9f421f8c166d544b3cddcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_404dda914bf2b566d9de209c85f268dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_c4ca85934940789ba99a2e488339f04c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_0463aaa4295e4587a7164ed6611b5cdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_56ad353516292b48643fc8a648f11472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_a48863113a3ac2a310a30cb62f5ada5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_7ca8ca4dee0744e0f5d83fc4986855b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_e372def725ba66a527fd1fbeecad8f46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_1c33ef5e6c41a9413f09bf7e81590512.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12f132b5-f0fe-511a-b86e-853d24b43e08/12f132b5-f0fe-511a-b86e-853d24b43e08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/4f/f84fb2cf698b836aa3a3b5876f500820/pa/JS02864_ceba2b033d132ccdfec542501066709d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Scala 1.0 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2021}
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS02864%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [auto1.fr] INFO: Saving data for JS02864: {'created_time': 1774872837.363308, 'last_price_update_time': 1774872837.363319, 'auction_closing_time': 1774970332.0}
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JS02864') HTTP/1.1" 204 0
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV30331> (referer: https://www.auto1.com/v1/car-details-view/JV30331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9710e397-0d8d-5347-8d7f-f7216a789862 with identifier: JV30331
2026-03-30 12:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9710e397-0d8d-5347-8d7f-f7216a789862 with scrape type 1
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_533787df1fc8a73c54cd92b936217f37.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_533787df1fc8a73c54cd92b936217f37.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_fbb269273f7f1580e120de1884749056.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_fbb269273f7f1580e120de1884749056.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_c4abc6db72368b0612c1ed65455be7aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_c4abc6db72368b0612c1ed65455be7aa.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_df172c374259dc3013e8766bff57f58c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_df172c374259dc3013e8766bff57f58c.jpg not downloaded yet
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_2bd8521254605ee68f8697095f7d7861.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_2bd8521254605ee68f8697095f7d7861.jpg not downloaded yet
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_fbb269273f7f1580e120de1884749056.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_92e797e789d5b1d567e22dd0655fdba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_92e797e789d5b1d567e22dd0655fdba0.jpg not downloaded yet
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_533787df1fc8a73c54cd92b936217f37.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_a26159fc02c58a16832882f07c952e02.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_a26159fc02c58a16832882f07c952e02.jpg not downloaded yet
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg not downloaded yet
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_2bd8521254605ee68f8697095f7d7861.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a03950>
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_fbb269273f7f1580e120de1884749056.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_fbb269273f7f1580e120de1884749056.jpg saved to cache
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728507a590>
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_533787df1fc8a73c54cd92b936217f37.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_533787df1fc8a73c54cd92b936217f37.jpg saved to cache
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a12210>
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg saved to cache
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0c610>
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_2bd8521254605ee68f8697095f7d7861.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_2bd8521254605ee68f8697095f7d7861.jpg saved to cache
2026-03-30 12:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_92e797e789d5b1d567e22dd0655fdba0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_a26159fc02c58a16832882f07c952e02.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b4590>
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a25e10>
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c242d0>
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_92e797e789d5b1d567e22dd0655fdba0.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_92e797e789d5b1d567e22dd0655fdba0.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_df172c374259dc3013e8766bff57f58c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_c4abc6db72368b0612c1ed65455be7aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850eb050>
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_a26159fc02c58a16832882f07c952e02.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_a26159fc02c58a16832882f07c952e02.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b495d0>
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_df172c374259dc3013e8766bff57f58c.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_df172c374259dc3013e8766bff57f58c.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72851192d0>
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F99%252Fff99f7e6b067d5b6b21e6786b88b8b16%252Fpa%252FJV30331_c4abc6db72368b0612c1ed65455be7aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_c4abc6db72368b0612c1ed65455be7aa.jpg saved to cache
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9710e397-0d8d-5347-8d7f-f7216a789862
2026-03-30 12:13:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9710e397-0d8d-5347-8d7f-f7216a789862, skipping ID generation
2026-03-30 12:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9710e397-0d8d-5347-8d7f-f7216a789862 with scrape type 1
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9710e397-0d8d-5347-8d7f-f7216a789862 sending to next pipeline
2026-03-30 12:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9710e397-0d8d-5347-8d7f-f7216a789862, identifier: JV30331
2026-03-30 12:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9710e397-0d8d-5347-8d7f-f7216a789862 with identifier: JV30331
2026-03-30 12:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9710e397-0d8d-5347-8d7f-f7216a789862 with identifier: JV30331
2026-03-30 12:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9710e397-0d8d-5347-8d7f-f7216a789862 with identifier: JV30331 to the API
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_c4abc6db72368b0612c1ed65455be7aa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:24:02Z',
'fuel_type': 'petrol',
'id': '9710e397-0d8d-5347-8d7f-f7216a789862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV30331',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '2008',
'odometer': 75608,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_533787df1fc8a73c54cd92b936217f37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_fbb269273f7f1580e120de1884749056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_e2200057eee1b5a0f6654eec48b3e55b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_5f5a2081fda4eab83f9e9d1f14aecc5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_c4abc6db72368b0612c1ed65455be7aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_df172c374259dc3013e8766bff57f58c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_2bd8521254605ee68f8697095f7d7861.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_92e797e789d5b1d567e22dd0655fdba0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_a26159fc02c58a16832882f07c952e02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9710e397-0d8d-5347-8d7f-f7216a789862/9710e397-0d8d-5347-8d7f-f7216a789862_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/99/ff99f7e6b067d5b6b21e6786b88b8b16/pa/JV30331_bc0219b012f28d8e5bf28e8ed7924756.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV30331%27 HTTP/1.1" 200 None
2026-03-30 12:13:58 [auto1.fr] INFO: Saving data for JV30331: {'created_time': 1774872838.839527, 'last_price_update_time': 1774872838.83954, 'auction_closing_time': 1774970642.0}
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV30331') HTTP/1.1" 204 0
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU76987> (referer: https://www.auto1.com/v1/car-details-view/SU76987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU91399> (referer: https://www.auto1.com/v1/car-details-view/TU91399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX18119> (referer: https://www.auto1.com/v1/car-details-view/VX18119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:13:58 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 14 pages/min), scraped 176 items (at 3 items/min)
2026-03-30 12:13:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ed94ebb-9735-5bae-937e-c85f986094b1 with identifier: SU76987
2026-03-30 12:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed94ebb-9735-5bae-937e-c85f986094b1 with scrape type 1
2026-03-30 12:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_0b72fa35984653c3234828e871cdc48e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b72fa35984653c3234828e871cdc48e.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg not downloaded yet
2026-03-30 12:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b30d689-17c7-5557-8162-849c1796fb65 with identifier: TU91399
2026-03-30 12:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b30d689-17c7-5557-8162-849c1796fb65 with scrape type 1
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg not downloaded yet
2026-03-30 12:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27fc32e9-25ef-57e5-86b1-65c4722305e6 with identifier: VX18119
2026-03-30 12:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27fc32e9-25ef-57e5-86b1-65c4722305e6 with scrape type 1
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_630a581bfbf47ed1afc8a543d7c59486.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_630a581bfbf47ed1afc8a543d7c59486.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_11b984c7f62522657a2cbd68f5807b9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11b984c7f62522657a2cbd68f5807b9a.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_dfaf7588a39f74fdf4378d11976967d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_dfaf7588a39f74fdf4378d11976967d5.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg not downloaded yet
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg not downloaded yet
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b72fa35984653c3234828e871cdc48e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg not downloaded yet
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_630a581bfbf47ed1afc8a543d7c59486.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_d19334298694a1b5f5b6c987250095ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_d19334298694a1b5f5b6c987250095ef.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_8ea545332bbae0fa71fe284c0163cff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8ea545332bbae0fa71fe284c0163cff5.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_2badbef72e2a638e4ed251d5779afec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_2badbef72e2a638e4ed251d5779afec9.jpg not downloaded yet
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_2ddb210bc1db2df7822e732081f16960.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_2ddb210bc1db2df7822e732081f16960.jpg not downloaded yet
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1d410>
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg saved to cache
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg not downloaded yet
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_62874fa4ee239746bf850f9505dd36c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_62874fa4ee239746bf850f9505dd36c5.jpg not downloaded yet
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b6b710>
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_0b72fa35984653c3234828e871cdc48e.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b72fa35984653c3234828e871cdc48e.jpg saved to cache
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fbff10>
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_630a581bfbf47ed1afc8a543d7c59486.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_630a581bfbf47ed1afc8a543d7c59486.jpg saved to cache
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg not downloaded yet
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fc95d0>
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg') HTTP/1.1" 204 0
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg saved to cache
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg not downloaded yet
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg not downloaded yet
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fa4750>
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f7ea50>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_dfaf7588a39f74fdf4378d11976967d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_2ddb210bc1db2df7822e732081f16960.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_2badbef72e2a638e4ed251d5779afec9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11b984c7f62522657a2cbd68f5807b9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg not downloaded yet
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_09316c2838036502f5fd6a61a2f31b4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_09316c2838036502f5fd6a61a2f31b4b.jpg not downloaded yet
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287cc3310>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fea50>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_62874fa4ee239746bf850f9505dd36c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fa65d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd24d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_dfaf7588a39f74fdf4378d11976967d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_dfaf7588a39f74fdf4378d11976967d5.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a11050>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_2ddb210bc1db2df7822e732081f16960.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_2ddb210bc1db2df7822e732081f16960.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a12610>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287a14350>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_2badbef72e2a638e4ed251d5779afec9.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_2badbef72e2a638e4ed251d5779afec9.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287a2ce50>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_11b984c7f62522657a2cbd68f5807b9a.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11b984c7f62522657a2cbd68f5807b9a.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8ea545332bbae0fa71fe284c0163cff5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b5690>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_62874fa4ee239746bf850f9505dd36c5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_62874fa4ee239746bf850f9505dd36c5.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a1f1d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c365d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287ccd0d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_8ea545332bbae0fa71fe284c0163cff5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8ea545332bbae0fa71fe284c0163cff5.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850da2d0>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850a8310>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850da790>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_09316c2838036502f5fd6a61a2f31b4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_d19334298694a1b5f5b6c987250095ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ae9410>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b5ee10>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg saved to cache
2026-03-30 12:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508fe10>
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ad3d50>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b5f710>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a0d250>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F8a%252F5f8a1a944935d5136f2d6a5fe30c2053%252Fpa%252FTU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b30d689-17c7-5557-8162-849c1796fb65
2026-03-30 12:14:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b30d689-17c7-5557-8162-849c1796fb65, skipping ID generation
2026-03-30 12:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b30d689-17c7-5557-8162-849c1796fb65 with scrape type 1
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b30d689-17c7-5557-8162-849c1796fb65 sending to next pipeline
2026-03-30 12:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b30d689-17c7-5557-8162-849c1796fb65, identifier: TU91399
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f78210>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fc7%252F6cc75e5a25b5f41d729e11365b0b8aca%252Fpa%252FSU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ed94ebb-9735-5bae-937e-c85f986094b1
2026-03-30 12:14:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ed94ebb-9735-5bae-937e-c85f986094b1, skipping ID generation
2026-03-30 12:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ed94ebb-9735-5bae-937e-c85f986094b1 with scrape type 1
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ed94ebb-9735-5bae-937e-c85f986094b1 sending to next pipeline
2026-03-30 12:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ed94ebb-9735-5bae-937e-c85f986094b1, identifier: SU76987
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728516a390>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_09316c2838036502f5fd6a61a2f31b4b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_09316c2838036502f5fd6a61a2f31b4b.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aae990>
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252Fbf%252Fbdbfb6d5a385dcfc670e47c603c0d653%252Fpa%252FVX18119_d19334298694a1b5f5b6c987250095ef.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_d19334298694a1b5f5b6c987250095ef.jpg saved to cache
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27fc32e9-25ef-57e5-86b1-65c4722305e6
2026-03-30 12:14:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27fc32e9-25ef-57e5-86b1-65c4722305e6, skipping ID generation
2026-03-30 12:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27fc32e9-25ef-57e5-86b1-65c4722305e6 with scrape type 1
2026-03-30 12:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27fc32e9-25ef-57e5-86b1-65c4722305e6 sending to next pipeline
2026-03-30 12:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 27fc32e9-25ef-57e5-86b1-65c4722305e6, identifier: VX18119
2026-03-30 12:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b30d689-17c7-5557-8162-849c1796fb65 with identifier: TU91399
2026-03-30 12:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b30d689-17c7-5557-8162-849c1796fb65 with identifier: TU91399
2026-03-30 12:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b30d689-17c7-5557-8162-849c1796fb65 with identifier: TU91399 to the API
2026-03-30 12:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:26:14Z',
'fuel_type': 'petrol',
'id': '1b30d689-17c7-5557-8162-849c1796fb65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU91399',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 97213,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_7dc65fbe13c06fc2f0d8c244f6d6ddcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8465fc1d6d883ebb3d2e6de1d7f4a5cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_6c5b1d09dc1afa69f24b2b1325313a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2149e7f51e2b02bcca5fd4baa8698d8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_5c0f16bff7c2e5a574bd4dcb816486ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_8ea545332bbae0fa71fe284c0163cff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_154602ee1e2a8277a0d6e078e5f43b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_2475e0bc974ae93a5900bbf2ddb36707.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_1a372b4c7191a1a83d947d5dfca439c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b30d689-17c7-5557-8162-849c1796fb65/1b30d689-17c7-5557-8162-849c1796fb65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/8a/5f8a1a944935d5136f2d6a5fe30c2053/pa/TU91399_cd1f977eb832c4a37169ff4a1dab9798.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2019}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU91399%27 HTTP/1.1" 200 None
2026-03-30 12:14:02 [auto1.fr] INFO: Saving data for TU91399: {'created_time': 1774872842.15686, 'last_price_update_time': 1774872842.156871, 'auction_closing_time': 1774970774.0}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU91399') HTTP/1.1" 204 0
2026-03-30 12:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ed94ebb-9735-5bae-937e-c85f986094b1 with identifier: SU76987
2026-03-30 12:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ed94ebb-9735-5bae-937e-c85f986094b1 with identifier: SU76987
2026-03-30 12:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ed94ebb-9735-5bae-937e-c85f986094b1 with identifier: SU76987 to the API
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 242,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:53:53Z',
'fuel_type': 'diesel',
'id': '3ed94ebb-9735-5bae-937e-c85f986094b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU76987',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 164204,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_7906fcfdd327bb01a40e621cc5756a3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b72fa35984653c3234828e871cdc48e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11f367a2011cc19f74bd6dbd3b287cde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_11b984c7f62522657a2cbd68f5807b9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_50efc27a6ab5e48268e9543d6a3309d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_ce8c4840bf61b302636311d61cd4b5bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_f855c342f7afc4ca898bd01cdea6ff86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_0b833d6751f9c9574897f7e2e00ed76e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_2ddb210bc1db2df7822e732081f16960.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ed94ebb-9735-5bae-937e-c85f986094b1/3ed94ebb-9735-5bae-937e-c85f986094b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/c7/6cc75e5a25b5f41d729e11365b0b8aca/pa/SU76987_62874fa4ee239746bf850f9505dd36c5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-14',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Driver Start&Stop',
'transmission': 'manual',
'trim': '33 L2H2 Driver Start&Stop',
'year': 2020}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU76987%27 HTTP/1.1" 200 None
2026-03-30 12:14:02 [auto1.fr] INFO: Saving data for SU76987: {'created_time': 1774872842.593084, 'last_price_update_time': 1774872842.593093, 'auction_closing_time': 1774972433.0}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU76987') HTTP/1.1" 204 0
2026-03-30 12:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27fc32e9-25ef-57e5-86b1-65c4722305e6 with identifier: VX18119
2026-03-30 12:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27fc32e9-25ef-57e5-86b1-65c4722305e6 with identifier: VX18119
2026-03-30 12:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27fc32e9-25ef-57e5-86b1-65c4722305e6 with identifier: VX18119 to the API
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_d19334298694a1b5f5b6c987250095ef.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:28:10Z',
'fuel_type': 'petrol',
'id': '27fc32e9-25ef-57e5-86b1-65c4722305e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX18119',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 81175,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_630a581bfbf47ed1afc8a543d7c59486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_dfaf7588a39f74fdf4378d11976967d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_33c603f0abef4745634e6f0cc2ee0d4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_1a0825e66e0f38edea9fd56c6b865a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_d19334298694a1b5f5b6c987250095ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_2badbef72e2a638e4ed251d5779afec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_cbf9d71bbedb505679d4f7a8b1fd29aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_8bbe10e110006cf8c3c6f1b0c6365cb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_bcb4ef5d74ef824a38b0954ea0e2e132.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fc32e9-25ef-57e5-86b1-65c4722305e6/27fc32e9-25ef-57e5-86b1-65c4722305e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/bf/bdbfb6d5a385dcfc670e47c603c0d653/pa/VX18119_09316c2838036502f5fd6a61a2f31b4b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Elite',
'transmission': 'manual',
'trim': 'Elite',
'year': 2017}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX18119%27 HTTP/1.1" 200 None
2026-03-30 12:14:02 [auto1.fr] INFO: Saving data for VX18119: {'created_time': 1774872842.975098, 'last_price_update_time': 1774872842.975109, 'auction_closing_time': 1774970890.0}
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX18119') HTTP/1.1" 204 0
2026-03-30 12:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX44661> (referer: https://www.auto1.com/v1/car-details-view/AX44661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD64881> (referer: https://www.auto1.com/v1/car-details-view/GD64881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1a859-e23f-5288-80bb-358f4efa8310 with identifier: AX44661
2026-03-30 12:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1a859-e23f-5288-80bb-358f4efa8310 with scrape type 1
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg not downloaded yet
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_687df45ba59b186c47c41f959ca71034.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_687df45ba59b186c47c41f959ca71034.jpg not downloaded yet
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg not downloaded yet
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_2be20a8417abed0c335eadab9633c342.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_2be20a8417abed0c335eadab9633c342.jpg not downloaded yet
2026-03-30 12:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-03-30 12:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d79949-a795-514f-8d94-d85b6a21e10a with scrape type 1
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 81d79949-a795-514f-8d94-d85b6a21e10a
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_03f20f1e9fb97e903d101bfa3840e4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_03f20f1e9fb97e903d101bfa3840e4df.jpg already downloaded
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_186d2eb6e440bd512a7f5fdc446e1088.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_186d2eb6e440bd512a7f5fdc446e1088.jpg already downloaded
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_38a7df6efc445df2905bd3812a477853.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_38a7df6efc445df2905bd3812a477853.jpg already downloaded
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_18f6576456c7e7292cb9dd436178a381.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_18f6576456c7e7292cb9dd436178a381.jpg already downloaded
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_f3d62a5a248c1ea279a1fde9cfba8a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_f3d62a5a248c1ea279a1fde9cfba8a8e.jpg already downloaded
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Faa%252Ff6aa1d5a6057678613378727305923d6%252Fpa%252FGD64881_6c4a6608cb109d7fece8a452e23be587.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_6c4a6608cb109d7fece8a452e23be587.jpg already downloaded
2026-03-30 12:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81d79949-a795-514f-8d94-d85b6a21e10a, identifier: GD64881
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg not downloaded yet
2026-03-30 12:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881
2026-03-30 12:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81d79949-a795-514f-8d94-d85b6a21e10a with identifier: GD64881 to the API
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD64881>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:40:15Z',
'fuel_type': 'petrol',
'id': '81d79949-a795-514f-8d94-d85b6a21e10a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD64881',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'DS3',
'odometer': 112736,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_03f20f1e9fb97e903d101bfa3840e4df.jpg',
'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_186d2eb6e440bd512a7f5fdc446e1088.jpg',
'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_38a7df6efc445df2905bd3812a477853.jpg',
'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_18f6576456c7e7292cb9dd436178a381.jpg',
'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_f3d62a5a248c1ea279a1fde9cfba8a8e.jpg',
'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_6c4a6608cb109d7fece8a452e23be587.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_03f20f1e9fb97e903d101bfa3840e4df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_186d2eb6e440bd512a7f5fdc446e1088.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_38a7df6efc445df2905bd3812a477853.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_18f6576456c7e7292cb9dd436178a381.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_f3d62a5a248c1ea279a1fde9cfba8a8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d79949-a795-514f-8d94-d85b6a21e10a/81d79949-a795-514f-8d94-d85b6a21e10a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/aa/f6aa1d5a6057678613378727305923d6/pa/GD64881_6c4a6608cb109d7fece8a452e23be587.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.4 VTi Chic',
'transmission': 'manual',
'trim': 'Chic',
'year': 2011}
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD64881%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [auto1.fr] INFO: Saving data for GD64881: {'created_time': 1774872845.879205, 'last_price_update_time': 1774872845.879218, 'auction_closing_time': 1774971615.0}
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD64881') HTTP/1.1" 204 0
2026-03-30 12:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_687df45ba59b186c47c41f959ca71034.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_8bbf33cf167da9f204fccbf31d36c708.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_8bbf33cf167da9f204fccbf31d36c708.jpg not downloaded yet
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg not downloaded yet
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_07625f75bb758327bb3bb17cb597c72f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_07625f75bb758327bb3bb17cb597c72f.jpg not downloaded yet
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_76ea2306c9cf02809e333c59cb480d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_76ea2306c9cf02809e333c59cb480d15.jpg not downloaded yet
2026-03-30 12:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg not downloaded yet
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b3d390>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f793d0>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_687df45ba59b186c47c41f959ca71034.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_687df45ba59b186c47c41f959ca71034.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_07625f75bb758327bb3bb17cb597c72f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_76ea2306c9cf02809e333c59cb480d15.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a54590>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_2be20a8417abed0c335eadab9633c342.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_8bbf33cf167da9f204fccbf31d36c708.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728507afd0>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287993150>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f8e4d0>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_07625f75bb758327bb3bb17cb597c72f.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_07625f75bb758327bb3bb17cb597c72f.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f78810>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_76ea2306c9cf02809e333c59cb480d15.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_76ea2306c9cf02809e333c59cb480d15.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd38d0>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b2090>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_2be20a8417abed0c335eadab9633c342.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_2be20a8417abed0c335eadab9633c342.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f83990>
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fac%252F75ac8fe5a7ee05460c5640ca4e11af45%252Fpa%252FAX44661_8bbf33cf167da9f204fccbf31d36c708.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_8bbf33cf167da9f204fccbf31d36c708.jpg saved to cache
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ba1a859-e23f-5288-80bb-358f4efa8310
2026-03-30 12:14:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ba1a859-e23f-5288-80bb-358f4efa8310, skipping ID generation
2026-03-30 12:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1a859-e23f-5288-80bb-358f4efa8310 with scrape type 1
2026-03-30 12:14:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ba1a859-e23f-5288-80bb-358f4efa8310 sending to next pipeline
2026-03-30 12:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ba1a859-e23f-5288-80bb-358f4efa8310, identifier: AX44661
2026-03-30 12:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ba1a859-e23f-5288-80bb-358f4efa8310 with identifier: AX44661
2026-03-30 12:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ba1a859-e23f-5288-80bb-358f4efa8310 with identifier: AX44661
2026-03-30 12:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ba1a859-e23f-5288-80bb-358f4efa8310 with identifier: AX44661 to the API
2026-03-30 12:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_8bbf33cf167da9f204fccbf31d36c708.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:07:41Z',
'fuel_type': 'petrol',
'id': '4ba1a859-e23f-5288-80bb-358f4efa8310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX44661',
'listing': 'auction',
'location': 'FR, Chalon-sur-Saône',
'make': 'Peugeot',
'model': '3008',
'odometer': 26029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_c7c15affb2b1a806ac126020fc9f3d1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_687df45ba59b186c47c41f959ca71034.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_d91c1f3e15f578f653d651ca7dc55c28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2672265,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_2be20a8417abed0c335eadab9633c342.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_340d6c4a505732d34cb5ec6b4a25aa03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2864535,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_8bbf33cf167da9f204fccbf31d36c708.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_e0f529ef5c2bea37bbd44af3040a2d92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_07625f75bb758327bb3bb17cb597c72f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_76ea2306c9cf02809e333c59cb480d15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba1a859-e23f-5288-80bb-358f4efa8310/4ba1a859-e23f-5288-80bb-358f4efa8310_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/ac/75ac8fe5a7ee05460c5640ca4e11af45/pa/AX44661_3a01c4930f0e8e27417d6e5cab08ad49.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 Mild-Hybrid Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2024}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX44661%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [auto1.fr] INFO: Saving data for AX44661: {'created_time': 1774872847.209053, 'last_price_update_time': 1774872847.209068, 'auction_closing_time': 1774969661.0}
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX44661') HTTP/1.1" 204 0
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY39287> (referer: https://www.auto1.com/v1/car-details-view/JY39287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with identifier: JY39287
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with scrape type 1
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_61db66dcf7202d56f5a84b9879db2c39.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_61db66dcf7202d56f5a84b9879db2c39.jpg not downloaded yet
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_317817757ab51276524e6ea04df30679.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_317817757ab51276524e6ea04df30679.jpg not downloaded yet
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg not downloaded yet
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_ea5173b326ba53f95caca8c24059319a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_ea5173b326ba53f95caca8c24059319a.jpg not downloaded yet
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg not downloaded yet
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg not downloaded yet
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_317817757ab51276524e6ea04df30679.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_61db66dcf7202d56f5a84b9879db2c39.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_ea5173b326ba53f95caca8c24059319a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fe8d0>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_317817757ab51276524e6ea04df30679.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_317817757ab51276524e6ea04df30679.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c0db10>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_61db66dcf7202d56f5a84b9879db2c39.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_61db66dcf7202d56f5a84b9879db2c39.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c36ed0>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bd2f90>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_ea5173b326ba53f95caca8c24059319a.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_ea5173b326ba53f95caca8c24059319a.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d3f10>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fbf210>
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F5e%252F5b5e8f04b49de74b55c04c536b974f74%252Fpa%252FJY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg saved to cache
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07
2026-03-30 12:14:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f59bded-8a26-5b85-bd9e-ac32e8691d07, skipping ID generation
2026-03-30 12:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with scrape type 1
2026-03-30 12:14:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f59bded-8a26-5b85-bd9e-ac32e8691d07 sending to next pipeline
2026-03-30 12:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8f59bded-8a26-5b85-bd9e-ac32e8691d07, identifier: JY39287
2026-03-30 12:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with identifier: JY39287
2026-03-30 12:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with identifier: JY39287
2026-03-30 12:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8f59bded-8a26-5b85-bd9e-ac32e8691d07 with identifier: JY39287 to the API
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:41:05Z',
'fuel_type': 'diesel',
'id': '8f59bded-8a26-5b85-bd9e-ac32e8691d07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY39287',
'listing': 'auction',
'location': 'FR, Échirolles',
'make': 'Renault',
'model': 'Clio',
'odometer': 217355,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_61db66dcf7202d56f5a84b9879db2c39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_317817757ab51276524e6ea04df30679.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_0cf30dc0fa43a2e2ab721b40dbc05141.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_ea5173b326ba53f95caca8c24059319a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_3db1e5b4fb71592e423f9bc7b30fb254.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f59bded-8a26-5b85-bd9e-ac32e8691d07/8f59bded-8a26-5b85-bd9e-ac32e8691d07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/5e/5b5e8f04b49de74b55c04c536b974f74/pa/JY39287_a371f87d5be6fc39d7ce1ab5bdbb72a0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique TomTom',
'transmission': 'manual',
'trim': 'Dynamique TomTom',
'year': 2010}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY39287%27 HTTP/1.1" 200 None
2026-03-30 12:14:08 [auto1.fr] INFO: Saving data for JY39287: {'created_time': 1774872848.308245, 'last_price_update_time': 1774872848.308259, 'auction_closing_time': 1774971665.0}
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY39287') HTTP/1.1" 204 0
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC36158> (referer: https://www.auto1.com/v1/car-details-view/GC36158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-03-30 12:14:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8016c3a-5cae-579a-8fd9-c83096fc75e4 with scrape type 1
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_57e593864dfcf1cecfaa4ef171f55651.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_57e593864dfcf1cecfaa4ef171f55651.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_8605876ca1e58a61c469a0f520166502.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_8605876ca1e58a61c469a0f520166502.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_b15bf39b1cf104aca130cf8a958db358.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_b15bf39b1cf104aca130cf8a958db358.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_92856033d2e42eaff3966c97882455d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_92856033d2e42eaff3966c97882455d7.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_bc97c4b218df15751ff95e7c18b4a825.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_bc97c4b218df15751ff95e7c18b4a825.jpg not downloaded yet
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_96ba8de3c3d482bf009ca36849ca382c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_96ba8de3c3d482bf009ca36849ca382c.jpg not downloaded yet
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_57e593864dfcf1cecfaa4ef171f55651.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_8605876ca1e58a61c469a0f520166502.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_647aa6ad118149e381bfa6e6b705952d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_647aa6ad118149e381bfa6e6b705952d.jpg not downloaded yet
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg not downloaded yet
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514fa10>
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_57e593864dfcf1cecfaa4ef171f55651.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_57e593864dfcf1cecfaa4ef171f55651.jpg saved to cache
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_b15bf39b1cf104aca130cf8a958db358.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_bc97c4b218df15751ff95e7c18b4a825.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_92856033d2e42eaff3966c97882455d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285140590>
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_8605876ca1e58a61c469a0f520166502.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_8605876ca1e58a61c469a0f520166502.jpg saved to cache
2026-03-30 12:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.225(s), this was the 1st time calling it.
2026-03-30 12:14:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.798952568416249 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72881513d0>
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_96ba8de3c3d482bf009ca36849ca382c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72881dff90>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_b15bf39b1cf104aca130cf8a958db358.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_b15bf39b1cf104aca130cf8a958db358.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fc9010>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_bc97c4b218df15751ff95e7c18b4a825.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_bc97c4b218df15751ff95e7c18b4a825.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c1e1d0>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf9310>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_92856033d2e42eaff3966c97882455d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_92856033d2e42eaff3966c97882455d7.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_647aa6ad118149e381bfa6e6b705952d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfbd10>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_96ba8de3c3d482bf009ca36849ca382c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_96ba8de3c3d482bf009ca36849ca382c.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285abf650>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_647aa6ad118149e381bfa6e6b705952d.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_647aa6ad118149e381bfa6e6b705952d.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72859fb910>
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F85%252F778547ea81bea7f0037ac3c6ec4343d3%252Fpa%252FGC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg saved to cache
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8016c3a-5cae-579a-8fd9-c83096fc75e4
2026-03-30 12:14:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8016c3a-5cae-579a-8fd9-c83096fc75e4, skipping ID generation
2026-03-30 12:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8016c3a-5cae-579a-8fd9-c83096fc75e4 with scrape type 1
2026-03-30 12:14:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8016c3a-5cae-579a-8fd9-c83096fc75e4 sending to next pipeline
2026-03-30 12:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8016c3a-5cae-579a-8fd9-c83096fc75e4, identifier: GC36158
2026-03-30 12:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-03-30 12:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158
2026-03-30 12:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8016c3a-5cae-579a-8fd9-c83096fc75e4 with identifier: GC36158 to the API
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:06:54Z',
'fuel_type': 'petrol',
'id': 'f8016c3a-5cae-579a-8fd9-c83096fc75e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC36158',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '208',
'odometer': 86660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_57e593864dfcf1cecfaa4ef171f55651.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_8605876ca1e58a61c469a0f520166502.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_a7efc3baf9898c7240fd8c6a3c226adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_b15bf39b1cf104aca130cf8a958db358.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_2a8d7abb8429a0f8c889d7c360f2befc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_92856033d2e42eaff3966c97882455d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_bc97c4b218df15751ff95e7c18b4a825.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_96ba8de3c3d482bf009ca36849ca382c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_647aa6ad118149e381bfa6e6b705952d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8016c3a-5cae-579a-8fd9-c83096fc75e4/f8016c3a-5cae-579a-8fd9-c83096fc75e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/85/778547ea81bea7f0037ac3c6ec4343d3/pa/GC36158_f5302f45c518e95be33c9dd84dcdf61c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC36158%27 HTTP/1.1" 200 None
2026-03-30 12:14:12 [auto1.fr] INFO: Saving data for GC36158: {'created_time': 1774872852.943413, 'last_price_update_time': 1774872852.943424, 'auction_closing_time': 1774969614.0}
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC36158') HTTP/1.1" 204 0
2026-03-30 12:14:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.261(s), this was the 1st time calling it.
2026-03-30 12:14:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.291106105388131 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV46129> (referer: https://www.auto1.com/v1/car-details-view/ZV46129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with identifier: ZV46129
2026-03-30 12:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with scrape type 1
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_b4155aed73ee8a54ad7798f033f10076.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_b4155aed73ee8a54ad7798f033f10076.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a4866b98d71b264320cb7224c855687d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4866b98d71b264320cb7224c855687d.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a968c192fde964ea8d4129359463839c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a968c192fde964ea8d4129359463839c.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg not downloaded yet
2026-03-30 12:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_b4155aed73ee8a54ad7798f033f10076.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg not downloaded yet
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg not downloaded yet
2026-03-30 12:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4866b98d71b264320cb7224c855687d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_ff624680f0094f863064b25b6ba73c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_ff624680f0094f863064b25b6ba73c3b.jpg not downloaded yet
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a98250>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_b4155aed73ee8a54ad7798f033f10076.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_b4155aed73ee8a54ad7798f033f10076.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_ff624680f0094f863064b25b6ba73c3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f8d210>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a4866b98d71b264320cb7224c855687d.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4866b98d71b264320cb7224c855687d.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850d0bd0>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a968c192fde964ea8d4129359463839c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fcb2d0>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728511ac90>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_ff624680f0094f863064b25b6ba73c3b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_ff624680f0094f863064b25b6ba73c3b.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879dd650>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285079790>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508a7d0>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284fcac50>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_a968c192fde964ea8d4129359463839c.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a968c192fde964ea8d4129359463839c.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c58550>
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252Fe8%252F1de83502596cbd0b4dd3466dd91c5b57%252Fpa%252FZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg saved to cache
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0
2026-03-30 12:14:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c76ee545-b0a1-55a9-972e-9f93c3fc08a0, skipping ID generation
2026-03-30 12:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with scrape type 1
2026-03-30 12:14:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c76ee545-b0a1-55a9-972e-9f93c3fc08a0 sending to next pipeline
2026-03-30 12:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c76ee545-b0a1-55a9-972e-9f93c3fc08a0, identifier: ZV46129
2026-03-30 12:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with identifier: ZV46129
2026-03-30 12:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with identifier: ZV46129
2026-03-30 12:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c76ee545-b0a1-55a9-972e-9f93c3fc08a0 with identifier: ZV46129 to the API
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 55,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:51:22Z',
'fuel_type': 'hybrid',
'id': 'c76ee545-b0a1-55a9-972e-9f93c3fc08a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV46129',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'MINI',
'model': 'Countryman',
'odometer': 88073,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_b4155aed73ee8a54ad7798f033f10076.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4866b98d71b264320cb7224c855687d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_cbf5f559d8f6fc63532ea91945be6b6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_f672bf54a93dbda4a4288d0bcf7d7573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_14f80c9fe95eceea5e1544d25e2f910e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a968c192fde964ea8d4129359463839c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_fd9c5568dd29bcbde897de33626d6e1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_6b61ccb7e2a43064ead4b6e11eac5b8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_a4e780ad6d03aad857c624cd3ef6fc97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76ee545-b0a1-55a9-972e-9f93c3fc08a0/c76ee545-b0a1-55a9-972e-9f93c3fc08a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/e8/1de83502596cbd0b4dd3466dd91c5b57/pa/ZV46129_ff624680f0094f863064b25b6ba73c3b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S E Hybrid ALL4 Chili',
'transmission': 'automatic',
'trim': 'ALL4 Chili',
'year': 2018}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV46129%27 HTTP/1.1" 200 None
2026-03-30 12:14:17 [auto1.fr] INFO: Saving data for ZV46129: {'created_time': 1774872857.041413, 'last_price_update_time': 1774872857.041422, 'auction_closing_time': 1774972282.0}
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV46129') HTTP/1.1" 204 0
2026-03-30 12:14:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW25296> (referer: https://www.auto1.com/v1/car-details-view/AW25296/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with identifier: AW25296
2026-03-30 12:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with scrape type 1
2026-03-30 12:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_7be335adf0e6c0f3a579d446354248dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7be335adf0e6c0f3a579d446354248dc.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_b2464eb639ab4e59cab84f7608a0a506.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_b2464eb639ab4e59cab84f7608a0a506.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_246396ea127484df7115afb8c2b1cae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_246396ea127484df7115afb8c2b1cae2.jpg not downloaded yet
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_fcb86b82615724d6f404a8773eb6d452.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_fcb86b82615724d6f404a8773eb6d452.jpg not downloaded yet
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7be335adf0e6c0f3a579d446354248dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_ff31c85afa854a610cb5194cf64d587b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_ff31c85afa854a610cb5194cf64d587b.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg not downloaded yet
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg not downloaded yet
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_246396ea127484df7115afb8c2b1cae2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72851349d0>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285145d10>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_ff31c85afa854a610cb5194cf64d587b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850e9210>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285aebb10>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_7be335adf0e6c0f3a579d446354248dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7be335adf0e6c0f3a579d446354248dc.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf7990>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_246396ea127484df7115afb8c2b1cae2.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_246396ea127484df7115afb8c2b1cae2.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285c70390>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_ff31c85afa854a610cb5194cf64d587b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_ff31c85afa854a610cb5194cf64d587b.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f79f10>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bfe4d0>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg saved to cache
2026-03-30 12:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_b2464eb639ab4e59cab84f7608a0a506.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_fcb86b82615724d6f404a8773eb6d452.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850b2f10>
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_b2464eb639ab4e59cab84f7608a0a506.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_b2464eb639ab4e59cab84f7608a0a506.jpg saved to cache
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a987d0>
2026-03-30 12:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F7c%252Fe47c25bf2842edc953f49c66cb1e2b82%252Fpa%252FAW25296_fcb86b82615724d6f404a8773eb6d452.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_fcb86b82615724d6f404a8773eb6d452.jpg saved to cache
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a
2026-03-30 12:14:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a, skipping ID generation
2026-03-30 12:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with scrape type 1
2026-03-30 12:14:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a sending to next pipeline
2026-03-30 12:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a, identifier: AW25296
2026-03-30 12:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with identifier: AW25296
2026-03-30 12:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with identifier: AW25296
2026-03-30 12:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a with identifier: AW25296 to the API
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_fcb86b82615724d6f404a8773eb6d452.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:30:22Z',
'fuel_type': 'diesel',
'id': '7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW25296',
'listing': 'auction',
'location': 'FR, Herblay',
'make': 'Fiat',
'model': '500X',
'odometer': 136039,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7b6685d7ad124ca915f9f4c4a5012cb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_5a512d08d72cb4b8a4e2528d7821b5ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_7be335adf0e6c0f3a579d446354248dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_e95d8fc2762dc4605e6fccdc6cdbd3cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2971352,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_b2464eb639ab4e59cab84f7608a0a506.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_246396ea127484df7115afb8c2b1cae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2968435,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_fcb86b82615724d6f404a8773eb6d452.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_ff31c85afa854a610cb5194cf64d587b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_17c66b07ca6bbb7ba2e09b87a5eb46f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a/7ebbca29-d38f-5dcc-9e8b-6e70a71bbb8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/7c/e47c25bf2842edc953f49c66cb1e2b82/pa/AW25296_61fd099f3f233c11aed6c186a5b94ec8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM S-Design',
'transmission': 'manual',
'trim': 'S-Design',
'year': 2018}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW25296%27 HTTP/1.1" 200 None
2026-03-30 12:14:28 [auto1.fr] INFO: Saving data for AW25296: {'created_time': 1774872868.82307, 'last_price_update_time': 1774872868.823083, 'auction_closing_time': 1774971022.0}
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW25296') HTTP/1.1" 204 0
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS29137> (referer: https://www.auto1.com/v1/car-details-view/DS29137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with identifier: DS29137
2026-03-30 12:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with scrape type 1
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_973351a93cc4e5f967eb16204929f6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_973351a93cc4e5f967eb16204929f6c7.jpg not downloaded yet
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_e2c6153d83dc140b26640a866dd0fee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_e2c6153d83dc140b26640a866dd0fee8.jpg not downloaded yet
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_f516f074fa5c32ab74d82574d304714b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_f516f074fa5c32ab74d82574d304714b.jpg not downloaded yet
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg not downloaded yet
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_a3652a37762f37b4a38b244c4590f700.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_a3652a37762f37b4a38b244c4590f700.jpg not downloaded yet
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_8931761a9563e1d3a1fca744c43cd580.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_8931761a9563e1d3a1fca744c43cd580.jpg not downloaded yet
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_e2c6153d83dc140b26640a866dd0fee8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg not downloaded yet
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_973351a93cc4e5f967eb16204929f6c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_c11cf516b5029dccfca0ab221e492dc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_c11cf516b5029dccfca0ab221e492dc8.jpg not downloaded yet
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_f516f074fa5c32ab74d82574d304714b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg not downloaded yet
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_b583e1340103767b5f86cbd687a68c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b583e1340103767b5f86cbd687a68c77.jpg not downloaded yet
2026-03-30 12:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_a3652a37762f37b4a38b244c4590f700.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850eb050>
2026-03-30 12:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_e2c6153d83dc140b26640a866dd0fee8.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_e2c6153d83dc140b26640a866dd0fee8.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72881ec050>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_973351a93cc4e5f967eb16204929f6c7.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_973351a93cc4e5f967eb16204929f6c7.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_c11cf516b5029dccfca0ab221e492dc8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_8931761a9563e1d3a1fca744c43cd580.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a63610>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_f516f074fa5c32ab74d82574d304714b.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_f516f074fa5c32ab74d82574d304714b.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf6e10>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285b38f10>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_a3652a37762f37b4a38b244c4590f700.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_a3652a37762f37b4a38b244c4590f700.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b583e1340103767b5f86cbd687a68c77.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7287da18d0>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72879d0490>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_c11cf516b5029dccfca0ab221e492dc8.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_c11cf516b5029dccfca0ab221e492dc8.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514ea50>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a04d10>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_8931761a9563e1d3a1fca744c43cd580.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_8931761a9563e1d3a1fca744c43cd580.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac5690>
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F09%252Fa7095a0cbbd5f83310d24a0f605eb4fc%252Fpa%252FDS29137_b583e1340103767b5f86cbd687a68c77.jpg') HTTP/1.1" 204 0
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b583e1340103767b5f86cbd687a68c77.jpg saved to cache
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec
2026-03-30 12:14:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec, skipping ID generation
2026-03-30 12:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with scrape type 1
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7fc735b-646f-543d-b9e8-f4eaeb1a88ec sending to next pipeline
2026-03-30 12:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec, identifier: DS29137
2026-03-30 12:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with identifier: DS29137
2026-03-30 12:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with identifier: DS29137
2026-03-30 12:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e7fc735b-646f-543d-b9e8-f4eaeb1a88ec with identifier: DS29137 to the API
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b583e1340103767b5f86cbd687a68c77.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:35:38Z',
'fuel_type': 'petrol',
'id': 'e7fc735b-646f-543d-b9e8-f4eaeb1a88ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS29137',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 196449,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_973351a93cc4e5f967eb16204929f6c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_e2c6153d83dc140b26640a866dd0fee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_f516f074fa5c32ab74d82574d304714b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_373fe8b7bf94092fca0cb8400c32d8a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_a3652a37762f37b4a38b244c4590f700.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_8931761a9563e1d3a1fca744c43cd580.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b8b4846fafff1c8a65677b9cdb80f3e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_c11cf516b5029dccfca0ab221e492dc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_d898be1c7b7f764ce3f2706f96fdcaf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7fc735b-646f-543d-b9e8-f4eaeb1a88ec/e7fc735b-646f-543d-b9e8-f4eaeb1a88ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/09/a7095a0cbbd5f83310d24a0f605eb4fc/pa/DS29137_b583e1340103767b5f86cbd687a68c77.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-08',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Beetle 1.4 TSI Fender Edition',
'transmission': 'automatic',
'trim': 'Fender Edition',
'year': 2013}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS29137%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.fr] INFO: Saving data for DS29137: {'created_time': 1774872877.05671, 'last_price_update_time': 1774872877.056724, 'auction_closing_time': 1774971338.0}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS29137') HTTP/1.1" 204 0
2026-03-30 12:14:58 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 7 pages/min), scraped 186 items (at 10 items/min)
2026-03-30 12:14:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:15:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.753(s), this was the 1st time calling it.
2026-03-30 12:15:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.466154628427649 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:15:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:15:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.612(s), this was the 1st time calling it.
2026-03-30 12:15:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.062713557458437 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:15:58 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 0 pages/min), scraped 186 items (at 0 items/min)
2026-03-30 12:15:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:16:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:38 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 5730 | hits on page: 40
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: JY39287
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY39287%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Scrape type for JY39287: 0
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: LJ73279
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: PU36088
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: TE38674
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: WV33218
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX44661%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Scrape type for AX44661: 0
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: JC65585
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: UZ77285
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: CK52934
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: RN04117
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: KK86719
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: XE90293
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: XK60858
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK90801%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Scrape type for UK90801: 0
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 12:16:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD81431%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Scrape type for VD81431: 0
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: YU78646
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: UT37188
2026-03-30 12:16:38 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ95816%27 HTTP/1.1" 200 None
2026-03-30 12:16:38 [auto1.fr] INFO: Scrape type for MZ95816: 2
2026-03-30 12:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-03-30 12:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with scrape type 2
2026-03-30 12:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with scrape type 2
2026-03-30 12:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4beede2-e56d-512d-bcd0-e42fcd81b3f7, identifier: MZ95816
2026-03-30 12:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-03-30 12:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816
2026-03-30 12:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4beede2-e56d-512d-bcd0-e42fcd81b3f7 with identifier: MZ95816 to the API
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:06:04Z',
'fuel_type': 'petrol',
'id': 'a4beede2-e56d-512d-bcd0-e42fcd81b3f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ95816',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pixo',
'odometer': 79710,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-03',
'seller_name': None,
'title': 'Nissan Pixo 1.0 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2009}
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ95816%27 HTTP/1.1" 200 None
2026-03-30 12:16:39 [auto1.fr] INFO: Saving data for MZ95816: {'auction_closing_time': 1774969564.0, 'created_time': 1773252812.025402, 'last_price_update_time': 1774872999.396234}
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MZ95816') HTTP/1.1" 204 0
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: AS29663
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: GR61820
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: RL98096
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL98096%27 HTTP/1.1" 200 None
2026-03-30 12:16:39 [auto1.fr] INFO: Scrape type for RL98096: 1
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: LN69242
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: PE74944
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: AF39730
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF39730%27 HTTP/1.1" 200 None
2026-03-30 12:16:39 [auto1.fr] INFO: Scrape type for AF39730: 2
2026-03-30 12:16:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4321149e-4f95-5b49-b3da-6af8115cf37e with identifier: AF39730
2026-03-30 12:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4321149e-4f95-5b49-b3da-6af8115cf37e with scrape type 2
2026-03-30 12:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4321149e-4f95-5b49-b3da-6af8115cf37e with scrape type 2
2026-03-30 12:16:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4321149e-4f95-5b49-b3da-6af8115cf37e, identifier: AF39730
2026-03-30 12:16:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4321149e-4f95-5b49-b3da-6af8115cf37e with identifier: AF39730
2026-03-30 12:16:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4321149e-4f95-5b49-b3da-6af8115cf37e with identifier: AF39730
2026-03-30 12:16:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4321149e-4f95-5b49-b3da-6af8115cf37e with identifier: AF39730 to the API
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 309,
'expiration_date': '2026-03-31T15:10:57Z',
'fuel_type': 'hybrid',
'id': '4321149e-4f95-5b49-b3da-6af8115cf37e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF39730',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 91194,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seller_name': None,
'title': 'Land Rover Discovery Sport P300e Hybrid SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2021}
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF39730%27 HTTP/1.1" 200 None
2026-03-30 12:16:39 [auto1.fr] INFO: Saving data for AF39730: {'auction_closing_time': 1774969857.0, 'created_time': 1774267026.10742, 'last_price_update_time': 1774872999.962268}
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF39730') HTTP/1.1" 204 0
2026-03-30 12:16:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: GV72759
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: NC92603
2026-03-30 12:16:39 [auto1.fr] INFO: Found listing with ID: HM15892
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM15892%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Scrape type for HM15892: 1
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: VG13093
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG13093%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Scrape type for VG13093: 1
2026-03-30 12:16:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: DS08548
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: ZL76511
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: AY12209
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: HS41994
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS41994%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Scrape type for HS41994: 2
2026-03-30 12:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ac50da5-f416-5eee-981c-6e0c9e794455 with identifier: HS41994
2026-03-30 12:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ac50da5-f416-5eee-981c-6e0c9e794455 with scrape type 2
2026-03-30 12:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ac50da5-f416-5eee-981c-6e0c9e794455 with scrape type 2
2026-03-30 12:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ac50da5-f416-5eee-981c-6e0c9e794455, identifier: HS41994
2026-03-30 12:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ac50da5-f416-5eee-981c-6e0c9e794455 with identifier: HS41994
2026-03-30 12:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ac50da5-f416-5eee-981c-6e0c9e794455 with identifier: HS41994
2026-03-30 12:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ac50da5-f416-5eee-981c-6e0c9e794455 with identifier: HS41994 to the API
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:17:07Z',
'fuel_type': 'petrol',
'id': '4ac50da5-f416-5eee-981c-6e0c9e794455',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS41994',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Ignis',
'odometer': 157048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-03',
'seller_name': None,
'title': 'Suzuki Ignis 1.3 GL',
'transmission': 'manual',
'trim': 'GL',
'year': 2007}
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS41994%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Saving data for HS41994: {'auction_closing_time': 1774970227.0, 'created_time': 1773692621.938478, 'last_price_update_time': 1774873000.469324}
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HS41994') HTTP/1.1" 204 0
2026-03-30 12:16:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: JK78743
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK78743%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Scrape type for JK78743: 0
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: AB32696
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB32696%27 HTTP/1.1" 200 None
2026-03-30 12:16:40 [auto1.fr] INFO: Scrape type for AB32696: 1
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: NU28621
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: XB55824
2026-03-30 12:16:40 [auto1.fr] INFO: Found listing with ID: UL28191
2026-03-30 12:16:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM15892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM15892> (referer: https://www.auto1.com/v1/car-details-view/HM15892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 079bca5b-12e8-5fd6-9429-1dff62c0d383 with identifier: HM15892
2026-03-30 12:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 079bca5b-12e8-5fd6-9429-1dff62c0d383 with scrape type 1
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 079bca5b-12e8-5fd6-9429-1dff62c0d383
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_4fa70e1b20a490ac461a0fd74d4576f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_4fa70e1b20a490ac461a0fd74d4576f9.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_b7722aff43def58e1b8f77cf35100928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_b7722aff43def58e1b8f77cf35100928.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_ad26cbce09c0007e8d57241b486d7bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ad26cbce09c0007e8d57241b486d7bc2.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_ed81df25ab532fbaecfdaa89d8981200.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ed81df25ab532fbaecfdaa89d8981200.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_7e4226a2685e922137d1744b5dfdbf72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7e4226a2685e922137d1744b5dfdbf72.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_e4061e0ded8db307550434048c15afb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_e4061e0ded8db307550434048c15afb7.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_7ac687794b2006ce6b864ce120945ded.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7ac687794b2006ce6b864ce120945ded.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_150e37fe281eb7a810c7c253327b6fe7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_150e37fe281eb7a810c7c253327b6fe7.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_64721509747d4a303a777ea0ea46a902.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_64721509747d4a303a777ea0ea46a902.jpg already downloaded
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fa3%252F5aa392f849b7bb66ffd9e58c7825d7af%252Fpa%252FHM15892_8af676d08d63acef441938121b6c678c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_8af676d08d63acef441938121b6c678c.jpg already downloaded
2026-03-30 12:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 079bca5b-12e8-5fd6-9429-1dff62c0d383, identifier: HM15892
2026-03-30 12:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 079bca5b-12e8-5fd6-9429-1dff62c0d383 with identifier: HM15892
2026-03-30 12:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 079bca5b-12e8-5fd6-9429-1dff62c0d383 with identifier: HM15892
2026-03-30 12:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 079bca5b-12e8-5fd6-9429-1dff62c0d383 with identifier: HM15892 to the API
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM15892>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:37:47Z',
'fuel_type': 'diesel',
'id': '079bca5b-12e8-5fd6-9429-1dff62c0d383',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM15892',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Renault',
'model': 'Koleos',
'odometer': 209940,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_4fa70e1b20a490ac461a0fd74d4576f9.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_b7722aff43def58e1b8f77cf35100928.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ad26cbce09c0007e8d57241b486d7bc2.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ed81df25ab532fbaecfdaa89d8981200.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7e4226a2685e922137d1744b5dfdbf72.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_e4061e0ded8db307550434048c15afb7.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7ac687794b2006ce6b864ce120945ded.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_150e37fe281eb7a810c7c253327b6fe7.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_64721509747d4a303a777ea0ea46a902.jpg',
'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_8af676d08d63acef441938121b6c678c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_4fa70e1b20a490ac461a0fd74d4576f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_b7722aff43def58e1b8f77cf35100928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ad26cbce09c0007e8d57241b486d7bc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_ed81df25ab532fbaecfdaa89d8981200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7e4226a2685e922137d1744b5dfdbf72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_e4061e0ded8db307550434048c15afb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_7ac687794b2006ce6b864ce120945ded.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_150e37fe281eb7a810c7c253327b6fe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2355325,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_64721509747d4a303a777ea0ea46a902.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_079bca5b-12e8-5fd6-9429-1dff62c0d383/079bca5b-12e8-5fd6-9429-1dff62c0d383_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/a3/5aa392f849b7bb66ffd9e58c7825d7af/pa/HM15892_8af676d08d63acef441938121b6c678c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Koleos 2.0 dCi Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2012}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM15892%27 HTTP/1.1" 200 None
2026-03-30 12:16:47 [auto1.fr] INFO: Saving data for HM15892: {'created_time': 1774873007.181914, 'last_price_update_time': 1774873007.181923, 'auction_closing_time': 1774971467.0}
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM15892') HTTP/1.1" 204 0
2026-03-30 12:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:48 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 5730 | hits on page: 40
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: VN55404
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN55404%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.fr] INFO: Scrape type for VN55404: 2
2026-03-30 12:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 693cc446-09bf-50b9-9b35-a3e916f0d4aa with identifier: VN55404
2026-03-30 12:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 693cc446-09bf-50b9-9b35-a3e916f0d4aa with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 693cc446-09bf-50b9-9b35-a3e916f0d4aa with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 693cc446-09bf-50b9-9b35-a3e916f0d4aa, identifier: VN55404
2026-03-30 12:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 693cc446-09bf-50b9-9b35-a3e916f0d4aa with identifier: VN55404
2026-03-30 12:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 693cc446-09bf-50b9-9b35-a3e916f0d4aa with identifier: VN55404
2026-03-30 12:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 693cc446-09bf-50b9-9b35-a3e916f0d4aa with identifier: VN55404 to the API
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:45:29Z',
'fuel_type': 'petrol',
'id': '693cc446-09bf-50b9-9b35-a3e916f0d4aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN55404',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 30060,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-08',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo GS',
'transmission': 'manual',
'trim': 'GS',
'year': 2023}
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN55404%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.fr] INFO: Saving data for VN55404: {'auction_closing_time': 1774971929.0, 'created_time': 1774297936.467724, 'last_price_update_time': 1774873008.484522}
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN55404') HTTP/1.1" 204 0
2026-03-30 12:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: WS14634
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: NA77187
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: JH89520
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH89520%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.fr] INFO: Scrape type for JH89520: 1
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: YS10684
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: TX45559
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX45559%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.fr] INFO: Scrape type for TX45559: 1
2026-03-30 12:16:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: RP46008
2026-03-30 12:16:48 [auto1.fr] INFO: Found listing with ID: RZ94972
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ94972%27 HTTP/1.1" 200 None
2026-03-30 12:16:48 [auto1.fr] INFO: Scrape type for RZ94972: 2
2026-03-30 12:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf755c4-8127-52fe-a1f3-d9c17c827dae with identifier: RZ94972
2026-03-30 12:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf755c4-8127-52fe-a1f3-d9c17c827dae with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf755c4-8127-52fe-a1f3-d9c17c827dae with scrape type 2
2026-03-30 12:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: caf755c4-8127-52fe-a1f3-d9c17c827dae, identifier: RZ94972
2026-03-30 12:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: caf755c4-8127-52fe-a1f3-d9c17c827dae with identifier: RZ94972
2026-03-30 12:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: caf755c4-8127-52fe-a1f3-d9c17c827dae with identifier: RZ94972
2026-03-30 12:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: caf755c4-8127-52fe-a1f3-d9c17c827dae with identifier: RZ94972 to the API
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:11:05Z',
'fuel_type': 'diesel',
'id': 'caf755c4-8127-52fe-a1f3-d9c17c827dae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ94972',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 201764,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-10',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ94972%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.fr] INFO: Saving data for RZ94972: {'auction_closing_time': 1774969865.0, 'created_time': 1774298080.22188, 'last_price_update_time': 1774873009.08245}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ94972') HTTP/1.1" 204 0
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: DG00282
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: RG95907
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG95907%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.fr] INFO: Scrape type for RG95907: 2
2026-03-30 12:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 453a38b1-c842-5e5f-996b-fab60d4f0da2 with identifier: RG95907
2026-03-30 12:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453a38b1-c842-5e5f-996b-fab60d4f0da2 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 453a38b1-c842-5e5f-996b-fab60d4f0da2 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 453a38b1-c842-5e5f-996b-fab60d4f0da2, identifier: RG95907
2026-03-30 12:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 453a38b1-c842-5e5f-996b-fab60d4f0da2 with identifier: RG95907
2026-03-30 12:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 453a38b1-c842-5e5f-996b-fab60d4f0da2 with identifier: RG95907
2026-03-30 12:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 453a38b1-c842-5e5f-996b-fab60d4f0da2 with identifier: RG95907 to the API
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:11:46Z',
'fuel_type': 'petrol',
'id': '453a38b1-c842-5e5f-996b-fab60d4f0da2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG95907',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 72572,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-30',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Elite Start/Stop 4x4',
'transmission': 'manual',
'trim': 'Elite Start/Stop 4x4',
'year': 2017}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG95907%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.fr] INFO: Saving data for RG95907: {'auction_closing_time': 1774969906.0, 'created_time': 1773674086.329861, 'last_price_update_time': 1774873009.677563}
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG95907') HTTP/1.1" 204 0
2026-03-30 12:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG13093/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: FH61572
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: ZG40832
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: NL69056
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: ET50464
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: FP01410
2026-03-30 12:16:49 [auto1.fr] INFO: Found listing with ID: HC90791
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC90791%27 HTTP/1.1" 200 None
2026-03-30 12:16:49 [auto1.fr] INFO: Scrape type for HC90791: 2
2026-03-30 12:16:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7dced9-de7f-5746-8381-62a3b97f5be4 with identifier: HC90791
2026-03-30 12:16:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7dced9-de7f-5746-8381-62a3b97f5be4 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f7dced9-de7f-5746-8381-62a3b97f5be4 with scrape type 2
2026-03-30 12:16:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f7dced9-de7f-5746-8381-62a3b97f5be4, identifier: HC90791
2026-03-30 12:16:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f7dced9-de7f-5746-8381-62a3b97f5be4 with identifier: HC90791
2026-03-30 12:16:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f7dced9-de7f-5746-8381-62a3b97f5be4 with identifier: HC90791
2026-03-30 12:16:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f7dced9-de7f-5746-8381-62a3b97f5be4 with identifier: HC90791 to the API
2026-03-30 12:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:33:15Z',
'fuel_type': 'diesel',
'id': '4f7dced9-de7f-5746-8381-62a3b97f5be4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC90791',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 234110,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-17',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2017}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC90791%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.fr] INFO: Saving data for HC90791: {'auction_closing_time': 1774971195.0, 'created_time': 1774384760.833586, 'last_price_update_time': 1774873010.127713}
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC90791') HTTP/1.1" 204 0
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: TB91463
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: RX01850
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: PH66344
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: RL54968
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: TD64566
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ10054%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.fr] INFO: Scrape type for LJ10054: 0
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT05552%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.fr] INFO: Scrape type for HT05552: 0
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58814%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [auto1.fr] INFO: Scrape type for NC58814: 0
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 12:16:50 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:53 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 5730 | hits on page: 40
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX56195%27 HTTP/1.1" 200 None
2026-03-30 12:16:53 [auto1.fr] INFO: Scrape type for VX56195: 0
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR90410%27 HTTP/1.1" 200 None
2026-03-30 12:16:53 [auto1.fr] INFO: Scrape type for HR90410: 0
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP85932%27 HTTP/1.1" 200 None
2026-03-30 12:16:53 [auto1.fr] INFO: Scrape type for XP85932: 0
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: NN99848
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN99848%27 HTTP/1.1" 200 None
2026-03-30 12:16:53 [auto1.fr] INFO: Scrape type for NN99848: 0
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: SS89133
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: VT37001
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: ZN87379
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: NV27506
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: GV52982
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: BN28756
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: AD91227
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: ZC95968
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: XK83942
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: XK81760
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: EH51062
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: JY76757
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: AX22473
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: MZ41837
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: EF10438
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: XL94041
2026-03-30 12:16:53 [auto1.fr] INFO: Found listing with ID: YA21876
2026-03-30 12:16:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:54 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 5730 | hits on page: 40
2026-03-30 12:16:54 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 12:16:54 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 12:16:54 [auto1.fr] INFO: Found listing with ID: GG22552
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG22552%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for GG22552: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: NN01775
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN01775%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for NN01775: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: CU28394
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU28394%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for CU28394: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: JK29705
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: SR20214
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR20214%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for SR20214: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: LT76736
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: LB48009
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: KH84545
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: VF20612
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: TG26507
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: NV80033
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV80033%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for NV80033: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: KJ05424
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: GF80669
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF80669%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for GF80669: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: HC61208
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC61208%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for HC61208: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: VM65091
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: WY28346
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY28346%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for WY28346: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: RM38030
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM38030%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for RM38030: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: RB12134
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB12134%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for RB12134: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: BD87596
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: DK47228
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK47228%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for DK47228: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: KA87751
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: JA17926
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: VM16147
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: ER22788
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: KH57146
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: ZG90152
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: CP15038
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP15038%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for CP15038: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: WD39316
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD39316%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for WD39316: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: FE06802
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: KA87239
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: FR98174
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: PG03000
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: MB18852
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB18852%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for MB18852: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: GS75094
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS75094%27 HTTP/1.1" 200 None
2026-03-30 12:16:55 [auto1.fr] INFO: Scrape type for GS75094: 0
2026-03-30 12:16:55 [auto1.fr] INFO: Found listing with ID: ET15310
2026-03-30 12:16:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:56 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 5730 | hits on page: 40
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BX78480
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: CJ89974
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89974%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for CJ89974: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: WP13025
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: HV51188
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: ML28729
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BM94017
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: KR98838
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR98838%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for KR98838: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: CP37955
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: LJ18319
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: GR98034
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: MK42469
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: SL62587
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: PC27087
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: ZP95502
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: YT36285
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT36285%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for YT36285: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: XR02166
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BV69061
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: UC77970
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC77970%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for UC77970: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: DH30848
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: MR83440
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BK72121
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: KH85386
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH85386%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for KH85386: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: DH64426
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH64426%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for DH64426: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: NJ39357
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: VC57641
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: TY69433
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: NG03536
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: EL57210
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: FP49208
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP49208%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for FP49208: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BR79428
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: VS37711
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS37711%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for VS37711: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT15244%27 HTTP/1.1" 200 None
2026-03-30 12:16:56 [auto1.fr] INFO: Scrape type for KT15244: 0
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 12:16:56 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 12:16:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH89520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:58 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at 9 pages/min), scraped 194 items (at 8 items/min)
2026-03-30 12:16:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:17:58 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at 0 pages/min), scraped 194 items (at 0 items/min)
2026-03-30 12:17:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:18:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.776(s), this was the 2nd time calling it.
2026-03-30 12:18:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.019396384729135 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE89724/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.872(s), this was the 1st time calling it.
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.752431760511064 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.502(s), this was the 1st time calling it.
2026-03-30 12:18:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.234273917653298 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL98096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.480(s), this was the 1st time calling it.
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.736335290299896 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:58 [scrapy.extensions.logstats] INFO: Crawled 224 pages (at 2 pages/min), scraped 194 items (at 0 items/min)
2026-03-30 12:18:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.526(s), this was the 1st time calling it.
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.244170866817003 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL98096> (referer: https://www.auto1.com/v1/car-details-view/RL98096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52dc28ee-3b8c-5f92-9647-52255a8aee0b with identifier: RL98096
2026-03-30 12:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52dc28ee-3b8c-5f92-9647-52255a8aee0b with scrape type 1
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52dc28ee-3b8c-5f92-9647-52255a8aee0b
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_ab189c6abc9779bf35f5273d7ac9e685.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ab189c6abc9779bf35f5273d7ac9e685.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_83bed2b72c04f4c1f49fd2103c6b51a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_83bed2b72c04f4c1f49fd2103c6b51a0.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_cb5f8459ccbdf0a4dfa715139a139f47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_cb5f8459ccbdf0a4dfa715139a139f47.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_b657dfc9a423fcd53cbde2fc9ecb2ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_b657dfc9a423fcd53cbde2fc9ecb2ff1.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_0844d64eb0cf3690000fdeb5ae4dce11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0844d64eb0cf3690000fdeb5ae4dce11.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_861cef7c3f6bdec58ac78b09ad256106.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_861cef7c3f6bdec58ac78b09ad256106.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_4d9b629c387fc269568fdaf6ccda576f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_4d9b629c387fc269568fdaf6ccda576f.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_0582a9961d2b5b016c468be90db11702.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0582a9961d2b5b016c468be90db11702.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_ae838a465889aaab825113960e62c078.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ae838a465889aaab825113960e62c078.jpg already downloaded
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fdc%252F06dc047ec53221bfb1de7b7cb675d4ea%252Fpa%252FRL98096_18fd9e26939f3d9e59db5a18abd5b79d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_18fd9e26939f3d9e59db5a18abd5b79d.jpg already downloaded
2026-03-30 12:19:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52dc28ee-3b8c-5f92-9647-52255a8aee0b, identifier: RL98096
2026-03-30 12:19:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52dc28ee-3b8c-5f92-9647-52255a8aee0b with identifier: RL98096
2026-03-30 12:19:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52dc28ee-3b8c-5f92-9647-52255a8aee0b with identifier: RL98096
2026-03-30 12:19:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 52dc28ee-3b8c-5f92-9647-52255a8aee0b with identifier: RL98096 to the API
2026-03-30 12:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL98096>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:02:54Z',
'fuel_type': 'petrol',
'id': '52dc28ee-3b8c-5f92-9647-52255a8aee0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL98096',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Opel',
'model': 'Corsa',
'odometer': 38409,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ab189c6abc9779bf35f5273d7ac9e685.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_83bed2b72c04f4c1f49fd2103c6b51a0.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_cb5f8459ccbdf0a4dfa715139a139f47.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_b657dfc9a423fcd53cbde2fc9ecb2ff1.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0844d64eb0cf3690000fdeb5ae4dce11.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_861cef7c3f6bdec58ac78b09ad256106.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_4d9b629c387fc269568fdaf6ccda576f.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0582a9961d2b5b016c468be90db11702.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ae838a465889aaab825113960e62c078.jpg',
'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_18fd9e26939f3d9e59db5a18abd5b79d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ab189c6abc9779bf35f5273d7ac9e685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_83bed2b72c04f4c1f49fd2103c6b51a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_cb5f8459ccbdf0a4dfa715139a139f47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604973,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_b657dfc9a423fcd53cbde2fc9ecb2ff1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0844d64eb0cf3690000fdeb5ae4dce11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_861cef7c3f6bdec58ac78b09ad256106.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_4d9b629c387fc269568fdaf6ccda576f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_0582a9961d2b5b016c468be90db11702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_ae838a465889aaab825113960e62c078.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dc28ee-3b8c-5f92-9647-52255a8aee0b/52dc28ee-3b8c-5f92-9647-52255a8aee0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/dc/06dc047ec53221bfb1de7b7cb675d4ea/pa/RL98096_18fd9e26939f3d9e59db5a18abd5b79d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2019}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL98096%27 HTTP/1.1" 200 None
2026-03-30 12:19:04 [auto1.fr] INFO: Saving data for RL98096: {'created_time': 1774873144.150052, 'last_price_update_time': 1774873144.150065, 'auction_closing_time': 1774969374.0}
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RL98096') HTTP/1.1" 204 0
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.788(s), this was the 1st time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.443698135010607 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.895(s), this was the 1st time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.685815171519379 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX45559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX45559> (referer: https://www.auto1.com/v1/car-details-view/TX45559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9f94e58-2561-510b-9f54-9c9c98d5a5e5 with identifier: TX45559
2026-03-30 12:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9f94e58-2561-510b-9f54-9c9c98d5a5e5 with scrape type 1
2026-03-30 12:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9f94e58-2561-510b-9f54-9c9c98d5a5e5
2026-03-30 12:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_b35cc4c370e3f534e602218bef71393b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_b35cc4c370e3f534e602218bef71393b.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_18f20c46421b8873c1073715eb5539b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_18f20c46421b8873c1073715eb5539b9.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_074d620330e897f527c246984d21f9d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_074d620330e897f527c246984d21f9d5.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_1c5307319971e03a7ad588257e12bb3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_1c5307319971e03a7ad588257e12bb3a.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_7d412ff7772a30c5d7e2b980bdb222b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_7d412ff7772a30c5d7e2b980bdb222b5.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_5673bacf1bde0cb8b8d7d660b5c20980.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_5673bacf1bde0cb8b8d7d660b5c20980.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_a0c4ab268d140af2d87d0631541aec7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_a0c4ab268d140af2d87d0631541aec7c.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_fbe20e7e9909208ce227ae52212b41cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fbe20e7e9909208ce227ae52212b41cb.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_fb49f31587fe3602dacde32a9e429261.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fb49f31587fe3602dacde32a9e429261.jpg already downloaded
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F5f%252F935f23128309c930ad17091f5a1fb210%252Fpa%252FTX45559_e457a2cef364ba5a518354454fc20f3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_e457a2cef364ba5a518354454fc20f3c.jpg already downloaded
2026-03-30 12:19:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9f94e58-2561-510b-9f54-9c9c98d5a5e5, identifier: TX45559
2026-03-30 12:19:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9f94e58-2561-510b-9f54-9c9c98d5a5e5 with identifier: TX45559
2026-03-30 12:19:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9f94e58-2561-510b-9f54-9c9c98d5a5e5 with identifier: TX45559
2026-03-30 12:19:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9f94e58-2561-510b-9f54-9c9c98d5a5e5 with identifier: TX45559 to the API
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX45559>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:01:11Z',
'fuel_type': 'petrol',
'id': 'e9f94e58-2561-510b-9f54-9c9c98d5a5e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX45559',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 92476,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_b35cc4c370e3f534e602218bef71393b.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_18f20c46421b8873c1073715eb5539b9.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_074d620330e897f527c246984d21f9d5.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_1c5307319971e03a7ad588257e12bb3a.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_7d412ff7772a30c5d7e2b980bdb222b5.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_5673bacf1bde0cb8b8d7d660b5c20980.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_a0c4ab268d140af2d87d0631541aec7c.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fbe20e7e9909208ce227ae52212b41cb.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fb49f31587fe3602dacde32a9e429261.jpg',
'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_e457a2cef364ba5a518354454fc20f3c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_b35cc4c370e3f534e602218bef71393b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_18f20c46421b8873c1073715eb5539b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_074d620330e897f527c246984d21f9d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_1c5307319971e03a7ad588257e12bb3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_7d412ff7772a30c5d7e2b980bdb222b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_5673bacf1bde0cb8b8d7d660b5c20980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_a0c4ab268d140af2d87d0631541aec7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fbe20e7e9909208ce227ae52212b41cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_fb49f31587fe3602dacde32a9e429261.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9f94e58-2561-510b-9f54-9c9c98d5a5e5/e9f94e58-2561-510b-9f54-9c9c98d5a5e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/5f/935f23128309c930ad17091f5a1fb210/pa/TX45559_e457a2cef364ba5a518354454fc20f3c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX45559%27 HTTP/1.1" 200 None
2026-03-30 12:19:18 [auto1.fr] INFO: Saving data for TX45559: {'created_time': 1774873158.628973, 'last_price_update_time': 1774873158.628983, 'auction_closing_time': 1774969271.0}
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX45559') HTTP/1.1" 204 0
2026-03-30 12:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:23 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 5738 | hits on page: 40
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT15244%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for KT15244: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: DJ58290
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: DX45828
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: RH58772
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: VZ61146
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ61146%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for VZ61146: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: MB07680
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: PV49045
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: FV37446
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: TP09076
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: EG55368
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: YK96178
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: RX28214
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: MM01049
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: TU22359
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: SV83520
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: ZU71183
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: TL43630
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: XL92817
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL92817%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for XL92817: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: TC56491
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC56491%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for TC56491: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: NV76103
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: KV21640
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV21640%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for KV21640: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: KB61906
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61906%27 HTTP/1.1" 200 None
2026-03-30 12:19:23 [auto1.fr] INFO: Scrape type for KB61906: 0
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: PA77686
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: SY29297
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: CF60384
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: BX52558
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: HM35105
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: HS81476
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: TT94112
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: ZU29510
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: SX04652
2026-03-30 12:19:23 [auto1.fr] INFO: Found listing with ID: BK23856
2026-03-30 12:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:24 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 5738 | hits on page: 40
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: DT54800
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: PX14877
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX14877%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for PX14877: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: UR06829
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TA74732
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: LD13478
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: GD92514
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: FV10697
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV10697%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for FV10697: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TU46522
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: CM07289
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: XG30202
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: AL74013
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: VS30684
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TN98594
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: FX72814
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: EC55821
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: JJ80448
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: MJ43566
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: ZZ19761
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: NS56484
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: UZ78191
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: GR61554
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: RD55039
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: SU67266
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TY27143
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: CF24077
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TW89495
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW89495%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for TW89495: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: GM82732
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM82732%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for GM82732: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: JR89101
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: PE76789
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE76789%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for PE76789: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: TM96159
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM96159%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for TM96159: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: EW80890
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW80890%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for EW80890: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: LA42071
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: NK60668
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK60668%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for NK60668: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: JC04729
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: WU38484
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU38484%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for WU38484: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: CH43272
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH43272%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for CH43272: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: BE87790
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE87790%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for BE87790: 0
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: UL81175
2026-03-30 12:19:24 [auto1.fr] INFO: Found listing with ID: PH43278
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH43278%27 HTTP/1.1" 200 None
2026-03-30 12:19:24 [auto1.fr] INFO: Scrape type for PH43278: 0
2026-03-30 12:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:28 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 5738 | hits on page: 40
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: PG45287
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: XN84792
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN84792%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for XN84792: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: GU38048
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU38048%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for GU38048: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: LY30069
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY30069%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for LY30069: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: ZG81108
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: ZV53128
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV53128%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for ZV53128: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: JA85521
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: NN44286
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: YF90779
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF90779%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for YF90779: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: ZJ95567
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: FS13979
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: EG04160
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: TF56803
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF56803%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for TF56803: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: BK02644
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: KV99093
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV99093%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for KV99093: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: XP51935
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: ZH33585
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH33585%27 HTTP/1.1" 200 None
2026-03-30 12:19:28 [auto1.fr] INFO: Scrape type for ZH33585: 0
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: BE56161
2026-03-30 12:19:28 [auto1.fr] INFO: Found listing with ID: KG84776
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG84776%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for KG84776: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: RP02904
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: KV37155
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: RD69787
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD69787%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for RD69787: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: XP70683
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP70683%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for XP70683: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: MV30877
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: YD24944
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: UB44080
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: CY41732
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: JX53268
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: VJ25498
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ25498%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for VJ25498: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: PH34253
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: ZY67756
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: WE41857
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: HL16171
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: BG53255
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: MK81616
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK81616%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for MK81616: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: VL74516
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU60832%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for ZU60832: 0
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 12:19:29 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA79253%27 HTTP/1.1" 200 None
2026-03-30 12:19:29 [auto1.fr] INFO: Scrape type for SA79253: 0
2026-03-30 12:19:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:58 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 6 pages/min), scraped 196 items (at 2 items/min)
2026-03-30 12:19:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:02 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:02 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU60832%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for ZU60832: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA79253%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for SA79253: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: TP39004
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: VV06327
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV06327%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for VV06327: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: YV95357
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: CW97175
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: TZ76111
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: MR25927
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: EL79670
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL79670%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for EL79670: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: HF97027
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: DC78531
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: JC25064
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC25064%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for JC25064: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: HG95528
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG95528%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for HG95528: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: FX87997
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: FU18661
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: EE45585
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: UT20394
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT20394%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for UT20394: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: MX13044
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: EF63082
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF63082%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for EF63082: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: VX78818
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX78818%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for VX78818: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: AP09710
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: TT35591
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: RN36299
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: BH31485
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH31485%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for BH31485: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: EL93658
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: MU42358
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: BL12426
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: WZ54212
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: ZB04396
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: MA06902
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA06902%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for MA06902: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: WM34767
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34767%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for WM34767: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: MZ22730
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: GR12789
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: BR89045
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: DU77787
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: KH06244
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH06244%27 HTTP/1.1" 200 None
2026-03-30 12:20:03 [auto1.fr] INFO: Scrape type for KH06244: 0
2026-03-30 12:20:03 [auto1.fr] INFO: Found listing with ID: AT01769
2026-03-30 12:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:15 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: BT62919
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: NY21368
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: XH36862
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH36862%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for XH36862: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: GU34103
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: LW46673
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW46673%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for LW46673: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: ND89234
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: XS84278
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: DS91007
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: GE11364
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE11364%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for GE11364: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: VY02503
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY02503%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for VY02503: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: TZ02960
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: NA76127
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU05349%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for DU05349: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: MJ09819
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ09819%27 HTTP/1.1" 200 None
2026-03-30 12:20:15 [auto1.fr] INFO: Scrape type for MJ09819: 0
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: PD24885
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: TL76456
2026-03-30 12:20:15 [auto1.fr] INFO: Found listing with ID: EZ26130
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ26130%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for EZ26130: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: BM92439
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM92439%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for BM92439: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: TS19753
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: BD67200
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD67200%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for BD67200: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: FR00063
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: CN82695
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: JP18496
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP18496%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for JP18496: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB66420%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for ZB66420: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: HA49256
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA49256%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for HA49256: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: RH62537
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: YY77064
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: PU50020
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: HL00485
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: EX77707
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: SZ69370
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: ZK36934
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK36934%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for ZK36934: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: YN55052
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: AB09197
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB09197%27 HTTP/1.1" 200 None
2026-03-30 12:20:16 [auto1.fr] INFO: Scrape type for AB09197: 0
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: LW26050
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: AP20381
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: CT46807
2026-03-30 12:20:16 [auto1.fr] INFO: Found listing with ID: ED23855
2026-03-30 12:20:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:18 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: HB74151
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: YF69984
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: PM43892
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: ZJ93568
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: EA40746
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: KG95545
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: DL27365
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: LZ24855
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ24855%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for LZ24855: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: LD43486
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: ZA49650
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: GK39924
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK39924%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for GK39924: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: SU63674
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU63674%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for SU63674: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: CA16747
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: AR83930
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: CA24685
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: TD13797
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD13797%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for TD13797: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: LY83162
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: RM94276
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: PK06687
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: EG00883
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: VT21499
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: KM03386
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM03386%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for KM03386: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: GF24817
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: LM21992
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU40978%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for JU40978: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: MJ39952
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ39952%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for MJ39952: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: UB50505
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: AX81873
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: JD11645
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD11645%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for JD11645: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: JZ73334
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ73334%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for JZ73334: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: NF74996
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF74996%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for NF74996: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: BY79094
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY79094%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for BY79094: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: CY49772
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: ZP74906
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: UT28849
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: HZ48160
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: SD16900
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: WB70972
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB70972%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for WB70972: 0
2026-03-30 12:20:18 [auto1.fr] INFO: Found listing with ID: GC25257
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC25257%27 HTTP/1.1" 200 None
2026-03-30 12:20:18 [auto1.fr] INFO: Scrape type for GC25257: 0
2026-03-30 12:20:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.319(s), this was the 1st time calling it.
2026-03-30 12:20:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.295240314727495 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:27 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 5740 | hits on page: 40
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: AW19486
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: JW96914
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP70951%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for BP70951: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ53685%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for NJ53685: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: UD43738
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: YB57255
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB57255%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for YB57255: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: TT51673
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: AP91610
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: MG48887
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: FW94560
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: ZZ88049
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: JD71808
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD71808%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for JD71808: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: ZP58765
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: VN94368
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: SB34610
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: WD64082
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: WM66922
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: XB39561
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: FD08548
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08548%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for FD08548: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: RJ05241
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: ZE84012
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: GP66530
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: YG18113
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: LL00787
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: TV66965
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: YF91947
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: CF64953
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: LX96530
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX96530%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for LX96530: 0
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: VC72866
2026-03-30 12:20:27 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA19729%27 HTTP/1.1" 200 None
2026-03-30 12:20:27 [auto1.fr] INFO: Scrape type for TA19729: 0
2026-03-30 12:20:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:20:31 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 5741 | hits on page: 40
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA19729%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for TA19729: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: AW72987
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: NX24565
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: JR54529
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: TJ20151
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: EH91855
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: UP72076
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: CR64037
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: VP32926
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: SD52344
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: AH27666
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: BK72500
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: AD80452
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: VF51675
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: HF01727
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: NZ06649
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ06649%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for NZ06649: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: GF46246
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: XJ44372
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ44372%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for XJ44372: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: ZC86979
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: SG18598
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: JJ02643
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ02643%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for JJ02643: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: AR69869
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: DA80805
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: SE67845
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: PR33870
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: LD85442
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: HH88390
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: ZZ73666
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: HB02679
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: LA59879
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA59879%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for LA59879: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: RM50552
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: GC31391
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: CY61543
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: RG55649
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG55649%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for RG55649: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: WU20781
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: RT86658
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: SJ36026
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ36026%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.fr] INFO: Scrape type for SJ36026: 0
2026-03-30 12:20:31 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 12:20:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE89724> (referer: https://www.auto1.com/v1/car-details-view/RE89724/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac662a8-e889-5928-86a6-3e61d212e72f with identifier: RE89724
2026-03-30 12:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac662a8-e889-5928-86a6-3e61d212e72f with scrape type 1
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac662a8-e889-5928-86a6-3e61d212e72f
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_578e10215d775f3837b51e4b2d388b03.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_578e10215d775f3837b51e4b2d388b03.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_6ae25e91897d832543939e2b0aed1ee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6ae25e91897d832543939e2b0aed1ee0.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_923b36f5c51c85c08d0bb4da100f4543.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_923b36f5c51c85c08d0bb4da100f4543.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_640a0baf584f73264e2029aca7dd9822.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_640a0baf584f73264e2029aca7dd9822.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_82a939e31abb8080af8fb64a93d910fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_82a939e31abb8080af8fb64a93d910fd.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_be8ba6d0a2658c877137ad6c303705ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_be8ba6d0a2658c877137ad6c303705ef.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_0978258e498fb3408d1c0b846ad66fca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_0978258e498fb3408d1c0b846ad66fca.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_a7212fa573ed482fb1d4aab782823a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_a7212fa573ed482fb1d4aab782823a98.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_faf4751df4190b093829b48383bcc6db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_faf4751df4190b093829b48383bcc6db.jpg already downloaded
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff4%252F7df4d373bafbf68680102f5288137af1%252Fpa%252FRE89724_6f3db24e290ad361f47d30dfb75d5d7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6f3db24e290ad361f47d30dfb75d5d7e.jpg already downloaded
2026-03-30 12:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aac662a8-e889-5928-86a6-3e61d212e72f, identifier: RE89724
2026-03-30 12:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aac662a8-e889-5928-86a6-3e61d212e72f with identifier: RE89724
2026-03-30 12:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aac662a8-e889-5928-86a6-3e61d212e72f with identifier: RE89724
2026-03-30 12:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aac662a8-e889-5928-86a6-3e61d212e72f with identifier: RE89724 to the API
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE89724>
{'auction_title': '',
'c_o_2_emission_value': 181,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:50:53Z',
'fuel_type': 'diesel',
'id': 'aac662a8-e889-5928-86a6-3e61d212e72f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE89724',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': '3er',
'odometer': 280566,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_578e10215d775f3837b51e4b2d388b03.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6ae25e91897d832543939e2b0aed1ee0.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_923b36f5c51c85c08d0bb4da100f4543.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_640a0baf584f73264e2029aca7dd9822.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_82a939e31abb8080af8fb64a93d910fd.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_be8ba6d0a2658c877137ad6c303705ef.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_0978258e498fb3408d1c0b846ad66fca.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_a7212fa573ed482fb1d4aab782823a98.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_faf4751df4190b093829b48383bcc6db.jpg',
'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6f3db24e290ad361f47d30dfb75d5d7e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3050613,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_578e10215d775f3837b51e4b2d388b03.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3052253,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6ae25e91897d832543939e2b0aed1ee0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_923b36f5c51c85c08d0bb4da100f4543.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_640a0baf584f73264e2029aca7dd9822.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_82a939e31abb8080af8fb64a93d910fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_be8ba6d0a2658c877137ad6c303705ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_0978258e498fb3408d1c0b846ad66fca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_a7212fa573ed482fb1d4aab782823a98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_faf4751df4190b093829b48383bcc6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aac662a8-e889-5928-86a6-3e61d212e72f/aac662a8-e889-5928-86a6-3e61d212e72f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f4/7df4d373bafbf68680102f5288137af1/pa/RE89724_6f3db24e290ad361f47d30dfb75d5d7e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 330d xDrive Sport Design',
'transmission': 'automatic',
'trim': 'xDrive Sport Design',
'year': 2011}
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE89724%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [auto1.fr] INFO: Saving data for RE89724: {'created_time': 1774873236.536438, 'last_price_update_time': 1774873236.53646, 'auction_closing_time': 1774972253.0}
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE89724') HTTP/1.1" 204 0
2026-03-30 12:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:51 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 5742 | hits on page: 40
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UY92063
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: TU81762
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: NA46359
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: HC15132
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: AK73885
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: ZN81951
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN81951%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for ZN81951: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: SA63680
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UX42544
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX42544%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for UX42544: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: BK74323
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UZ07675
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ07675%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for UZ07675: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: TX49254
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UT17520
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: ML75206
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: VJ46136
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UY44160
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: HM45390
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM45390%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for HM45390: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: MC14213
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: KJ36885
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: PU11656
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: LL21207
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: ET58165
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ93019%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for VZ93019: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: ZP18872
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: VL26218
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: KM29309
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: SM81810
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: GD96207
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: NH35726
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: RZ50801
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UN32467
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: PP18187
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: CF93348
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF93348%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for CF93348: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UT91151
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT91151%27 HTTP/1.1" 200 None
2026-03-30 12:20:51 [auto1.fr] INFO: Scrape type for UT91151: 0
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: HG74686
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: JM16652
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: UZ43867
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: TY39394
2026-03-30 12:20:51 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 12:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:58 [scrapy.extensions.logstats] INFO: Crawled 237 pages (at 7 pages/min), scraped 197 items (at 1 items/min)
2026-03-30 12:20:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:00 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: NM34809
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM34809%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for NM34809: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: LM74101
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: BX20872
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: DN01805
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: MD23469
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: XL24411
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: AL18302
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: PR14744
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR14744%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for PR14744: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: KR92660
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR92660%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for KR92660: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: BA37950
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: EZ24123
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: GB07314
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: JJ56309
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: CW74569
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW74569%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for CW74569: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: CZ19931
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ19931%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for CZ19931: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: LW56484
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW56484%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for LW56484: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: BP57483
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: FF46254
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: VC85970
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: NN90836
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN90836%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for NN90836: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: PX69189
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: HC09349
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC09349%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for HC09349: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: NT78881
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: KJ34319
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ34319%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for KJ34319: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: GD98920
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: BL97827
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: SN72375
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: AF50767
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50767%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for AF50767: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: TD82166
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: LL67655
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL67655%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for LL67655: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: DT73802
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: UR16491
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: UF85890
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: HF06911
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: YK42959
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: LB87950
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB87950%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for LB87950: 0
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: WJ25626
2026-03-30 12:21:00 [auto1.fr] INFO: Found listing with ID: WA74870
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA74870%27 HTTP/1.1" 200 None
2026-03-30 12:21:00 [auto1.fr] INFO: Scrape type for WA74870: 0
2026-03-30 12:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.040(s), this was the 2nd time calling it.
2026-03-30 12:21:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.442426600284005 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.698(s), this was the 2nd time calling it.
2026-03-30 12:21:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.868202313859338 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB32696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.960(s), this was the 2nd time calling it.
2026-03-30 12:21:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.485169748910359 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:33 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 5743 | hits on page: 40
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: KC26562
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: PG06825
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG06825%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for PG06825: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: GM18501
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: JA07941
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA07941%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for JA07941: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: UD86149
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: FU06277
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: VZ89988
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: SH02811
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: MJ04505
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: RJ04391
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: TC15970
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: MD03627
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: LG69185
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: AW56765
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56765%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for AW56765: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: MX55612
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: XR55930
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: TT62412
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: GP20665
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: XF66924
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: HC72507
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC72507%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for HC72507: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: ML81854
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: ME64971
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME64971%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for ME64971: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: HD73220
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: WY65543
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: PP88505
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP88505%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for PP88505: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: MR10155
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: JF58444
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: BP08934
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: WZ16203
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ16203%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for WZ16203: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: DJ15962
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: RY35148
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: RZ14627
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ14627%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for RZ14627: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: WL88981
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: NE74351
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: KK28971
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: WJ27946
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ27946%27 HTTP/1.1" 200 None
2026-03-30 12:21:33 [auto1.fr] INFO: Scrape type for WJ27946: 0
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: WU93309
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 12:21:33 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 12:21:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB32696> (referer: https://www.auto1.com/v1/car-details-view/AB32696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with identifier: AB32696
2026-03-30 12:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with scrape type 1
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_8719c392ea0449036d16d7f1a8ae482b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8719c392ea0449036d16d7f1a8ae482b.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_e1266606b89e7e091cefee262db87e68.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_e1266606b89e7e091cefee262db87e68.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_0d9625dc300cc4a92144084bc31d3531.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0d9625dc300cc4a92144084bc31d3531.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_45d47f066a232f0eb49c5e4b616539f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_45d47f066a232f0eb49c5e4b616539f5.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_0c5c93316168863131e7af9403b33a39.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0c5c93316168863131e7af9403b33a39.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_8eaae20e480788b105dd045cd53b5084.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8eaae20e480788b105dd045cd53b5084.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_426cc3ea8a97911824090c46ab54868a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_426cc3ea8a97911824090c46ab54868a.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg not downloaded yet
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_4fab68d254e6a6e5209001052f9843d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_4fab68d254e6a6e5209001052f9843d8.jpg not downloaded yet
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0d9625dc300cc4a92144084bc31d3531.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_45d47f066a232f0eb49c5e4b616539f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0c5c93316168863131e7af9403b33a39.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_e1266606b89e7e091cefee262db87e68.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8eaae20e480788b105dd045cd53b5084.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_426cc3ea8a97911824090c46ab54868a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_4fab68d254e6a6e5209001052f9843d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8719c392ea0449036d16d7f1a8ae482b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728514d9d0>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_0d9625dc300cc4a92144084bc31d3531.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0d9625dc300cc4a92144084bc31d3531.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ac7c10>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850fd450>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_45d47f066a232f0eb49c5e4b616539f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_45d47f066a232f0eb49c5e4b616539f5.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285002090>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_0c5c93316168863131e7af9403b33a39.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0c5c93316168863131e7af9403b33a39.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285bf54d0>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_e1266606b89e7e091cefee262db87e68.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_e1266606b89e7e091cefee262db87e68.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284ffec10>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_8eaae20e480788b105dd045cd53b5084.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8eaae20e480788b105dd045cd53b5084.jpg saved to cache
2026-03-30 12:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728501a8d0>
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg saved to cache
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728513c750>
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_426cc3ea8a97911824090c46ab54868a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_426cc3ea8a97911824090c46ab54868a.jpg saved to cache
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285020050>
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_4fab68d254e6a6e5209001052f9843d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_4fab68d254e6a6e5209001052f9843d8.jpg saved to cache
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f72850034d0>
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fe6%252F5de691de8cc093d7e7561114c3b11b35%252Fpa%252FAB32696_8719c392ea0449036d16d7f1a8ae482b.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8719c392ea0449036d16d7f1a8ae482b.jpg saved to cache
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9
2026-03-30 12:21:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9, skipping ID generation
2026-03-30 12:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with scrape type 1
2026-03-30 12:21:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 sending to next pipeline
2026-03-30 12:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9, identifier: AB32696
2026-03-30 12:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with identifier: AB32696
2026-03-30 12:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with identifier: AB32696
2026-03-30 12:21:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9 with identifier: AB32696 to the API
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8719c392ea0449036d16d7f1a8ae482b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:59:02Z',
'fuel_type': 'petrol',
'id': 'e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB32696',
'listing': 'auction',
'location': 'FR, Bruges',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 106322,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2593390,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8719c392ea0449036d16d7f1a8ae482b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2605472,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_e1266606b89e7e091cefee262db87e68.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6c383b2aaddb2f0e9150f6179eaf2872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0d9625dc300cc4a92144084bc31d3531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_45d47f066a232f0eb49c5e4b616539f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_0c5c93316168863131e7af9403b33a39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_8eaae20e480788b105dd045cd53b5084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_426cc3ea8a97911824090c46ab54868a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_6a7ab10ccb9f59f72354566411e5c9ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9/e7221938-f1e2-5ab6-99c5-f0fd2ebd98b9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/e6/5de691de8cc093d7e7561114c3b11b35/pa/AB32696_4fab68d254e6a6e5209001052f9843d8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-11-08',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cabrio One',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB32696%27 HTTP/1.1" 200 None
2026-03-30 12:21:49 [auto1.fr] INFO: Saving data for AB32696: {'created_time': 1774873309.941376, 'last_price_update_time': 1774873309.941387, 'auction_closing_time': 1774972742.0}
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB32696') HTTP/1.1" 204 0
2026-03-30 12:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:51 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 5745 | hits on page: 40
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: VY61935
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: AH64815
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YH52342
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: ZF71458
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: AS01327
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS01327%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for AS01327: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: MK61341
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YF77818
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF77818%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for YF77818: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YK09697
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: RA45535
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA45535%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for RA45535: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YC64262
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: US02346
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: VS91787
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS91787%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for VS91787: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: HL50910
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: BK19685
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: JE71016
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE71016%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for JE71016: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: JA39798
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: GT00876
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: AL46960
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YR53014
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: WB17402
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: VC26390
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC26390%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for VC26390: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: SZ19354
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: DY80869
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY80869%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for DY80869: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: ED61493
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: TJ13454
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ13454%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for TJ13454: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YE95249
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: DS19828
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: BD81949
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: HS13722
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: ML02900
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML02900%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for ML02900: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: RK77982
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: BE67989
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE67989%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for BE67989: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: YH76503
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: ZG89703
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: HM47617
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM47617%27 HTTP/1.1" 200 None
2026-03-30 12:21:51 [auto1.fr] INFO: Scrape type for HM47617: 0
2026-03-30 12:21:51 [auto1.fr] INFO: Found listing with ID: TL49010
2026-03-30 12:21:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:55 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 5744 | hits on page: 40
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KF52114
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: SA43115
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: UV73863
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: XL20075
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: ER09200
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER09200%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for ER09200: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: GP11392
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KG49901
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: UD61888
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: RM00164
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: AS36390
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KU90889
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: VG73746
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG73746%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for VG73746: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: AL35462
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL35462%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for AL35462: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: NJ66482
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ66482%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for NJ66482: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: NW52748
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: EP29644
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: NS68677
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN39539%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for CN39539: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KY89343
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: AC64067
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: SR76530
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: EB39738
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: BU00959
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: NK57774
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: SV53673
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: EV92409
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV92409%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for EV92409: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: NM58837
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KP42994
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: KZ71097
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ71097%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for KZ71097: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: RC67764
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC67764%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for RC67764: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: HR35316
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR35316%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for HR35316: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: XL60481
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: FB22935
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: ZM82858
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: SB76672
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: XJ36230
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: VE53658
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE53658%27 HTTP/1.1" 200 None
2026-03-30 12:21:55 [auto1.fr] INFO: Scrape type for VE53658: 0
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: XY31555
2026-03-30 12:21:55 [auto1.fr] INFO: Found listing with ID: SY35677
2026-03-30 12:21:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:56 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 5744 | hits on page: 40
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: VW72716
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW72716%27 HTTP/1.1" 200 None
2026-03-30 12:21:56 [auto1.fr] INFO: Scrape type for VW72716: 0
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: DZ82419
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: KX23637
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX23637%27 HTTP/1.1" 200 None
2026-03-30 12:21:56 [auto1.fr] INFO: Scrape type for KX23637: 0
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: XU30024
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: FU08159
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: VU97414
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: DT80486
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: WM52776
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: RP20304
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: TW57421
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: YJ41205
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: RC17389
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: TR32584
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR32584%27 HTTP/1.1" 200 None
2026-03-30 12:21:56 [auto1.fr] INFO: Scrape type for TR32584: 0
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: MF63659
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF63659%27 HTTP/1.1" 200 None
2026-03-30 12:21:56 [auto1.fr] INFO: Scrape type for MF63659: 0
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: XG61570
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: WP40871
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: EZ02912
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ02912%27 HTTP/1.1" 200 None
2026-03-30 12:21:56 [auto1.fr] INFO: Scrape type for EZ02912: 0
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: MM27553
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: XA54724
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: LE66923
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: SB40125
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: GP95041
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: CZ77892
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: VR30765
2026-03-30 12:21:56 [auto1.fr] INFO: Found listing with ID: TG40570
2026-03-30 12:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40570%27 HTTP/1.1" 200 None
2026-03-30 12:21:57 [auto1.fr] INFO: Scrape type for TG40570: 0
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: HD96935
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: ZX14325
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: WH09116
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: YU99421
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: TT80789
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT80789%27 HTTP/1.1" 200 None
2026-03-30 12:21:57 [auto1.fr] INFO: Scrape type for TT80789: 0
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: TV87876
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV87876%27 HTTP/1.1" 200 None
2026-03-30 12:21:57 [auto1.fr] INFO: Scrape type for TV87876: 0
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: PV47971
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: XG32357
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: BB56606
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: NH32818
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: LZ87734
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ87734%27 HTTP/1.1" 200 None
2026-03-30 12:21:57 [auto1.fr] INFO: Scrape type for LZ87734: 0
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: YG68937
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG68937%27 HTTP/1.1" 200 None
2026-03-30 12:21:57 [auto1.fr] INFO: Scrape type for YG68937: 0
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: FX00689
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: CZ00697
2026-03-30 12:21:57 [auto1.fr] INFO: Found listing with ID: BC53965
2026-03-30 12:21:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:58 [scrapy.extensions.logstats] INFO: Crawled 244 pages (at 7 pages/min), scraped 198 items (at 1 items/min)
2026-03-30 12:21:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:01 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 5744 | hits on page: 40
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: NC54891
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: LP57599
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP57599%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for LP57599: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: CB31058
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: UN80440
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN80440%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for UN80440: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: YV99261
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV99261%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for YV99261: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: EZ77748
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: RP24230
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: UX03179
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW49915%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for HW49915: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX30870%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for CX30870: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM44955%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for WM44955: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC41245%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for PC41245: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB05529%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for HB05529: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: US33967
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: LM27279
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: FM08864
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: RV55233
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: FE50003
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: US09137
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US09137%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for US09137: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: WB86369
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: KB61769
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61769%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for KB61769: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: AA82428
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA82428%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for AA82428: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: FC34806
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: HD23941
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: UG12644
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: DF97740
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF97740%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for DF97740: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS35063%27 HTTP/1.1" 200 None
2026-03-30 12:22:01 [auto1.fr] INFO: Scrape type for PS35063: 0
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 12:22:01 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 12:22:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:22 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 5748 | hits on page: 40
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS35063%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for PS35063: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: GV16284
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: CH91166
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU78027%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for GU78027: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: UZ91010
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ91010%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for UZ91010: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: SL05897
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: UG53294
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: RY43712
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: EU28848
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: LG77466
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: CR73549
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR73549%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for CR73549: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: DU99453
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: MS42511
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42511%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for MS42511: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: LE66377
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE66377%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for LE66377: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: XS52367
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: DV55941
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: JD19463
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: WB51756
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: MH16363
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: KK35444
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: JC79144
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC79144%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for JC79144: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: JA97388
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA97388%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for JA97388: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: AH02524
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: GY97445
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: NR32441
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR32441%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for NR32441: 0
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: PA02750
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 12:22:22 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM92478%27 HTTP/1.1" 200 None
2026-03-30 12:22:22 [auto1.fr] INFO: Scrape type for JM92478: 0
2026-03-30 12:22:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:58 [scrapy.extensions.logstats] INFO: Crawled 246 pages (at 2 pages/min), scraped 198 items (at 0 items/min)
2026-03-30 12:22:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 400.862(s), this was the 3rd time calling it.
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.728184839399772 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 400.124(s), this was the 3rd time calling it.
2026-03-30 12:23:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.009361618340403 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG13093> (referer: https://www.auto1.com/v1/car-details-view/VG13093/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with identifier: VG13093
2026-03-30 12:23:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with scrape type 1
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_48eb55946b1623a35e89a0be9a223396.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_48eb55946b1623a35e89a0be9a223396.jpg not downloaded yet
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_b1750003c3df51d787666c737196a78d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b1750003c3df51d787666c737196a78d.jpg not downloaded yet
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_1f33e1558a691d97c3e0879e78d8a818.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_1f33e1558a691d97c3e0879e78d8a818.jpg not downloaded yet
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_e8be437577c0df761570efe703c9f5b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e8be437577c0df761570efe703c9f5b6.jpg not downloaded yet
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg not downloaded yet
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_b928df333f232973906aadb0d58f4a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b928df333f232973906aadb0d58f4a15.jpg not downloaded yet
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_48eb55946b1623a35e89a0be9a223396.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728507b9d0>
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_48eb55946b1623a35e89a0be9a223396.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_48eb55946b1623a35e89a0be9a223396.jpg saved to cache
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b928df333f232973906aadb0d58f4a15.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e8be437577c0df761570efe703c9f5b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b1750003c3df51d787666c737196a78d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_1f33e1558a691d97c3e0879e78d8a818.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728507b290>
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_b928df333f232973906aadb0d58f4a15.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b928df333f232973906aadb0d58f4a15.jpg saved to cache
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f728508cf50>
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_e8be437577c0df761570efe703c9f5b6.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e8be437577c0df761570efe703c9f5b6.jpg saved to cache
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285a9bf10>
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_b1750003c3df51d787666c737196a78d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b1750003c3df51d787666c737196a78d.jpg saved to cache
2026-03-30 12:23:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7284f98ed0>
2026-03-30 12:23:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_1f33e1558a691d97c3e0879e78d8a818.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_1f33e1558a691d97c3e0879e78d8a818.jpg saved to cache
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7285ad2550>
2026-03-30 12:23:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F18%252F321825f38448d38a49f3d388f01325b8%252Fpa%252FVG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg saved to cache
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626
2026-03-30 12:23:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0654b9e6-e7b1-5e4b-b311-5926bf11b626, skipping ID generation
2026-03-30 12:23:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with scrape type 1
2026-03-30 12:23:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0654b9e6-e7b1-5e4b-b311-5926bf11b626 sending to next pipeline
2026-03-30 12:23:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0654b9e6-e7b1-5e4b-b311-5926bf11b626, identifier: VG13093
2026-03-30 12:23:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with identifier: VG13093
2026-03-30 12:23:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with identifier: VG13093
2026-03-30 12:23:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0654b9e6-e7b1-5e4b-b311-5926bf11b626 with identifier: VG13093 to the API
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:14:55Z',
'fuel_type': 'petrol',
'id': '0654b9e6-e7b1-5e4b-b311-5926bf11b626',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG13093',
'listing': 'auction',
'location': 'FR, Ludres',
'make': 'Renault',
'model': 'Clio',
'odometer': 127797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_48eb55946b1623a35e89a0be9a223396.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b1750003c3df51d787666c737196a78d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_1f33e1558a691d97c3e0879e78d8a818.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e8be437577c0df761570efe703c9f5b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_e50daa497ce9ef8981c7749f2cf2643e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0654b9e6-e7b1-5e4b-b311-5926bf11b626/0654b9e6-e7b1-5e4b-b311-5926bf11b626_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img32/18/321825f38448d38a49f3d388f01325b8/pa/VG13093_b928df333f232973906aadb0d58f4a15.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.2 Campus',
'transmission': 'manual',
'trim': 'Campus',
'year': 2006}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG13093%27 HTTP/1.1" 200 None
2026-03-30 12:23:44 [auto1.fr] INFO: Saving data for VG13093: {'created_time': 1774873424.888942, 'last_price_update_time': 1774873424.888951, 'auction_closing_time': 1774970095.0}
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG13093') HTTP/1.1" 204 0
2026-03-30 12:23:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 12:23:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH89520> (referer: https://www.auto1.com/v1/car-details-view/JH89520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333525a8-45ae-5d8e-95fe-4c9d7cf4decd with identifier: JH89520
2026-03-30 12:23:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333525a8-45ae-5d8e-95fe-4c9d7cf4decd with scrape type 1
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 333525a8-45ae-5d8e-95fe-4c9d7cf4decd
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_d13f2f8e42a8aa32f7debd925bea150f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_d13f2f8e42a8aa32f7debd925bea150f.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_c65a77bef29266c3ca89d13851d3c808.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_c65a77bef29266c3ca89d13851d3c808.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_26c6f741bf9a1827d24cb67e785253a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_26c6f741bf9a1827d24cb67e785253a8.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_ba042e774eb9408a5a8d7243dc728d30.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_ba042e774eb9408a5a8d7243dc728d30.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_181b9cf329f0d9b7086f73767e07a6b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_181b9cf329f0d9b7086f73767e07a6b4.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_b875344e73bae0296c4762ffebb86b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_b875344e73bae0296c4762ffebb86b21.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_2f3d9f9609e03f1d63495b97f2246d3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_2f3d9f9609e03f1d63495b97f2246d3e.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_1ddf95a9c88f56437239d2edf3ec5d56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_1ddf95a9c88f56437239d2edf3ec5d56.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_3dd0bfbaecfd35232e55511e22f9e517.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_3dd0bfbaecfd35232e55511e22f9e517.jpg already downloaded
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F0a%252Fff0a1387dca246dc816468a7c66c6b33%252Fpa%252FJH89520_a472596f7b381955b980d8cfab182250.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_a472596f7b381955b980d8cfab182250.jpg already downloaded
2026-03-30 12:23:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 333525a8-45ae-5d8e-95fe-4c9d7cf4decd, identifier: JH89520
2026-03-30 12:23:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 333525a8-45ae-5d8e-95fe-4c9d7cf4decd with identifier: JH89520
2026-03-30 12:23:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 333525a8-45ae-5d8e-95fe-4c9d7cf4decd with identifier: JH89520
2026-03-30 12:23:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 333525a8-45ae-5d8e-95fe-4c9d7cf4decd with identifier: JH89520 to the API
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JH89520>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:02:34Z',
'fuel_type': 'diesel',
'id': '333525a8-45ae-5d8e-95fe-4c9d7cf4decd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH89520',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '207',
'odometer': 157520,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_d13f2f8e42a8aa32f7debd925bea150f.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_c65a77bef29266c3ca89d13851d3c808.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_26c6f741bf9a1827d24cb67e785253a8.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_ba042e774eb9408a5a8d7243dc728d30.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_181b9cf329f0d9b7086f73767e07a6b4.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_b875344e73bae0296c4762ffebb86b21.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_2f3d9f9609e03f1d63495b97f2246d3e.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_1ddf95a9c88f56437239d2edf3ec5d56.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_3dd0bfbaecfd35232e55511e22f9e517.jpg',
'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_a472596f7b381955b980d8cfab182250.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_d13f2f8e42a8aa32f7debd925bea150f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_c65a77bef29266c3ca89d13851d3c808.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2667184,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_26c6f741bf9a1827d24cb67e785253a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_ba042e774eb9408a5a8d7243dc728d30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_181b9cf329f0d9b7086f73767e07a6b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2633235,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_b875344e73bae0296c4762ffebb86b21.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_2f3d9f9609e03f1d63495b97f2246d3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_1ddf95a9c88f56437239d2edf3ec5d56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_3dd0bfbaecfd35232e55511e22f9e517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_333525a8-45ae-5d8e-95fe-4c9d7cf4decd/333525a8-45ae-5d8e-95fe-4c9d7cf4decd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621620,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/0a/ff0a1387dca246dc816468a7c66c6b33/pa/JH89520_a472596f7b381955b980d8cfab182250.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi Business Pack',
'transmission': 'manual',
'trim': 'Business Pack',
'year': 2011}
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH89520%27 HTTP/1.1" 200 None
2026-03-30 12:23:47 [auto1.fr] INFO: Saving data for JH89520: {'created_time': 1774873427.76458, 'last_price_update_time': 1774873427.76459, 'auction_closing_time': 1774969354.0}
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JH89520') HTTP/1.1" 204 0
2026-03-30 12:23:58 [scrapy.extensions.logstats] INFO: Crawled 248 pages (at 2 pages/min), scraped 200 items (at 2 items/min)
2026-03-30 12:23:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:24:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.109(s), this was the 1st time calling it.
2026-03-30 12:24:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.056025900360132 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:24:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:24:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:43 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 5756 | hits on page: 40
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM92478%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for JM92478: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: SC90011
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: DJ04240
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: JR92262
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR92262%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for JR92262: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: CZ59485
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: LJ50590
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ42976%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for EZ42976: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: AX20284
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: DT57563
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: LA97865
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: WW85348
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW85348%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for WW85348: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: VN06433
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN06433%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for VN06433: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: MR60637
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: UK47887
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: AU99962
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: FF11603
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: PU35447
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: SB24854
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: GN79133
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN79133%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for GN79133: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: CR56365
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: HV80802
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV80802%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for HV80802: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: RW72165
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: TS50900
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: WT80779
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: NY88929
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: BP08503
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: TU98697
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU98697%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for TU98697: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: DP24552
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: DC92769
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC92769%27 HTTP/1.1" 200 None
2026-03-30 12:24:43 [auto1.fr] INFO: Scrape type for DC92769: 0
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: LB88529
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 12:24:43 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 12:24:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:58 [scrapy.extensions.logstats] INFO: Crawled 249 pages (at 1 pages/min), scraped 200 items (at 0 items/min)
2026-03-30 12:24:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:49 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 5758 | hits on page: 40
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: WZ91976
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: YW24880
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: RD81906
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD85530%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for VD85530: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN83652%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for KN83652: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM88394%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for XM88394: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN69566%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for UN69566: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE52567%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for YE52567: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN71738%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for UN71738: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM48677%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for KM48677: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP56567%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for FP56567: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA97525%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for MA97525: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH51524%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for CH51524: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM18119%27 HTTP/1.1" 200 None
2026-03-30 12:25:49 [auto1.fr] INFO: Scrape type for SM18119: 0
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 12:25:49 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 12:25:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:58 [scrapy.extensions.logstats] INFO: Crawled 250 pages (at 1 pages/min), scraped 200 items (at 0 items/min)
2026-03-30 12:25:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:26:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:02 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB89702%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for GB89702: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR71892%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for BR71892: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC26827%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for HC26827: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT76916%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for GT76916: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY04533%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for GY04533: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS05436%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for CS05436: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43002%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for AV43002: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK86553%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for VK86553: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY50344%27 HTTP/1.1" 200 None
2026-03-30 12:26:02 [auto1.fr] INFO: Scrape type for MY50344: 0
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 12:26:02 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 12:26:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:35 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY70562%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for UY70562: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL62240%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for YL62240: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ96762%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for TZ96762: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH00678%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for PH00678: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF18286%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for UF18286: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV24862%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for YV24862: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF02731%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for RF02731: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ40576%27 HTTP/1.1" 200 None
2026-03-30 12:26:35 [auto1.fr] INFO: Scrape type for FJ40576: 0
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 12:26:35 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 12:26:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:39 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA46036%27 HTTP/1.1" 200 None
2026-03-30 12:26:39 [auto1.fr] INFO: Scrape type for ZA46036: 0
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR88362%27 HTTP/1.1" 200 None
2026-03-30 12:26:39 [auto1.fr] INFO: Scrape type for CR88362: 0
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC21367%27 HTTP/1.1" 200 None
2026-03-30 12:26:39 [auto1.fr] INFO: Scrape type for PC21367: 0
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 12:26:39 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT96951%27 HTTP/1.1" 200 None
2026-03-30 12:26:40 [auto1.fr] INFO: Scrape type for BT96951: 0
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA00783%27 HTTP/1.1" 200 None
2026-03-30 12:26:40 [auto1.fr] INFO: Scrape type for UA00783: 0
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR28660%27 HTTP/1.1" 200 None
2026-03-30 12:26:40 [auto1.fr] INFO: Scrape type for WR28660: 0
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 12:26:40 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 12:26:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:41 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 5759 | hits on page: 40
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL13971%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for GL13971: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43770%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for DL43770: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX51378%27 HTTP/1.1" 200 None
2026-03-30 12:26:41 [auto1.fr] INFO: Scrape type for WX51378: 0
2026-03-30 12:26:41 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 12:26:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC92167%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for RC92167: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN42642%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for BN42642: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN88913%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for FN88913: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR85507%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for PR85507: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV07532%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for VV07532: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG01990%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for YG01990: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY63896%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for JY63896: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC88438%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for TC88438: 0
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 12:26:42 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ20358%27 HTTP/1.1" 200 None
2026-03-30 12:26:42 [auto1.fr] INFO: Scrape type for JJ20358: 0
2026-03-30 12:26:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:58 [scrapy.extensions.logstats] INFO: Crawled 254 pages (at 4 pages/min), scraped 200 items (at 0 items/min)
2026-03-30 12:26:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:53 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 5761 | hits on page: 40
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ20358%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for JJ20358: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML08473%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for ML08473: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX16106%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for ZX16106: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ10525%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for ZJ10525: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD75857%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for JD75857: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG34864%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for WG34864: 0
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 12:27:53 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS10624%27 HTTP/1.1" 200 None
2026-03-30 12:27:53 [auto1.fr] INFO: Scrape type for HS10624: 2
2026-03-30 12:27:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b9e22d-fc37-5e21-826c-892c5f2f0734 with identifier: HS10624
2026-03-30 12:27:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b9e22d-fc37-5e21-826c-892c5f2f0734 with scrape type 2
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b9e22d-fc37-5e21-826c-892c5f2f0734 with scrape type 2
2026-03-30 12:27:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 53b9e22d-fc37-5e21-826c-892c5f2f0734, identifier: HS10624
2026-03-30 12:27:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 53b9e22d-fc37-5e21-826c-892c5f2f0734 with identifier: HS10624
2026-03-30 12:27:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 53b9e22d-fc37-5e21-826c-892c5f2f0734 with identifier: HS10624
2026-03-30 12:27:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 53b9e22d-fc37-5e21-826c-892c5f2f0734 with identifier: HS10624 to the API
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:02:01Z',
'fuel_type': 'diesel',
'id': '53b9e22d-fc37-5e21-826c-892c5f2f0734',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS10624',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 165251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS10624%27 HTTP/1.1" 200 None
2026-03-30 12:27:54 [auto1.fr] INFO: Saving data for HS10624: {'auction_closing_time': 1774882921.0, 'created_time': 1774383100.592731, 'last_price_update_time': 1774873674.541778}
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HS10624') HTTP/1.1" 204 0
2026-03-30 12:27:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ64632%27 HTTP/1.1" 200 None
2026-03-30 12:27:54 [auto1.fr] INFO: Scrape type for PZ64632: 0
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 12:27:54 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU48972%27 HTTP/1.1" 200 None
2026-03-30 12:27:54 [auto1.fr] INFO: Scrape type for YU48972: 0
2026-03-30 12:27:58 [scrapy.extensions.logstats] INFO: Crawled 255 pages (at 1 pages/min), scraped 201 items (at 1 items/min)
2026-03-30 12:27:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:27:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:59 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 5761 | hits on page: 40
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW47298%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for HW47298: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN42753%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for EN42753: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW84177%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for UW84177: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA45577%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for SA45577: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: DE97163
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ34832%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for BZ34832: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD77959%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for FD77959: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW16085%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for HW16085: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU78489%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for AU78489: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE99224%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for FE99224: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY37081%27 HTTP/1.1" 200 None
2026-03-30 12:27:59 [auto1.fr] INFO: Scrape type for SY37081: 0
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 12:27:59 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN85436%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for JN85436: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE57135%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for BE57135: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU34374%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for AU34374: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC16056%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for FC16056: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY34409%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for BY34409: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA74312%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for DA74312: 0
2026-03-30 12:28:00 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD02519%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.fr] INFO: Scrape type for AD02519: 0
2026-03-30 12:28:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:07 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 5762 | hits on page: 40
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD02519%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for AD02519: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA44831%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for HA44831: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE76262%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for AE76262: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ57262%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for KJ57262: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA43696%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for RA43696: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE75326%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for WE75326: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ53254%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for GZ53254: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT71606%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for NT71606: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF56121%27 HTTP/1.1" 200 None
2026-03-30 12:28:07 [auto1.fr] INFO: Scrape type for NF56121: 0
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 12:28:07 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 12:28:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:58 [scrapy.extensions.logstats] INFO: Crawled 257 pages (at 2 pages/min), scraped 201 items (at 0 items/min)
2026-03-30 12:28:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:29:58 [scrapy.extensions.logstats] INFO: Crawled 257 pages (at 0 pages/min), scraped 201 items (at 0 items/min)
2026-03-30 12:29:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:30:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.999(s), this was the 1st time calling it.
2026-03-30 12:30:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.025027853484538 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:27 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT71606%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for NT71606: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF56121%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for NF56121: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT28767%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for WT28767: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE38454%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for EE38454: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW11440%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for NW11440: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF09814%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for TF09814: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ50416%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for GJ50416: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT28444%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for HT28444: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY42811%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for NY42811: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ11877%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for MJ11877: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN14071%27 HTTP/1.1" 200 None
2026-03-30 12:30:27 [auto1.fr] INFO: Scrape type for ZN14071: 0
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 12:30:27 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 12:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:28 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG12911%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for UG12911: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY86301%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for PY86301: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP19096%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for CP19096: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW36341%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for GW36341: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN33446%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for LN33446: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: FM45887
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR88141%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for DR88141: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV47124%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for YV47124: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX80652%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for AX80652: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG02630%27 HTTP/1.1" 200 None
2026-03-30 12:30:28 [auto1.fr] INFO: Scrape type for NG02630: 0
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 12:30:28 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 12:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:30 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT87826%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for LT87826: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS77464%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for XS77464: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD98882%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for DD98882: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN16566%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for MN16566: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF69794%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for SF69794: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS10541%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for WS10541: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA30500%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for ZA30500: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN74584%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for SN74584: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA10515%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for CA10515: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP34796%27 HTTP/1.1" 200 None
2026-03-30 12:30:30 [auto1.fr] INFO: Scrape type for TP34796: 0
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 12:30:30 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 12:30:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:32 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 5771 | hits on page: 40
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM50372%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for JM50372: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD17568%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for JD17568: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX94493%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for GX94493: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX53860%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for VX53860: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP72244%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for RP72244: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB50812%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for XB50812: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB10220%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for PB10220: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC25764%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for MC25764: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB38417%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for ZB38417: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD31410%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for SD31410: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU85207%27 HTTP/1.1" 200 None
2026-03-30 12:30:32 [auto1.fr] INFO: Scrape type for TU85207: 0
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 12:30:32 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 12:30:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:41 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV16573%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for DV16573: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX41933%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for EX41933: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ74934%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for HZ74934: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV18579%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for BV18579: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG06006%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for XG06006: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF38064%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for SF38064: 0
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 12:30:41 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP26002%27 HTTP/1.1" 200 None
2026-03-30 12:30:41 [auto1.fr] INFO: Scrape type for WP26002: 0
2026-03-30 12:30:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:49 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 5772 | hits on page: 40
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX55572%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for EX55572: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX28956%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for HX28956: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT60963%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for VT60963: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG79135%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for TG79135: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH24829%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for AH24829: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG46745%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for AG46745: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK94381%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for ZK94381: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50439%27 HTTP/1.1" 200 None
2026-03-30 12:30:49 [auto1.fr] INFO: Scrape type for AF50439: 0
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 12:30:49 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 12:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:58 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 6 pages/min), scraped 201 items (at 0 items/min)
2026-03-30 12:30:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:06 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT53990%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for AT53990: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP29957%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for RP29957: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ37583%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for JJ37583: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP39805%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for EP39805: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA84537%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for HA84537: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX89614%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for YX89614: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA30172%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for VA30172: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA13556%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for BA13556: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY23598%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for VY23598: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH64562%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for AH64562: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL29340%27 HTTP/1.1" 200 None
2026-03-30 12:31:06 [auto1.fr] INFO: Scrape type for BL29340: 0
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 12:31:06 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 12:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:22 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP88493%27 HTTP/1.1" 200 None
2026-03-30 12:31:22 [auto1.fr] INFO: Scrape type for JP88493: 0
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM31104%27 HTTP/1.1" 200 None
2026-03-30 12:31:22 [auto1.fr] INFO: Scrape type for CM31104: 0
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD15144%27 HTTP/1.1" 200 None
2026-03-30 12:31:22 [auto1.fr] INFO: Scrape type for DD15144: 0
2026-03-30 12:31:22 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY42183%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for EY42183: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV24696%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for WV24696: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ01372%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for UJ01372: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD25027%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for ZD25027: 0
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 12:31:23 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC66576%27 HTTP/1.1" 200 None
2026-03-30 12:31:23 [auto1.fr] INFO: Scrape type for RC66576: 0
2026-03-30 12:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:25 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK80550%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for SK80550: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP91356%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for CP91356: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF12539%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for AF12539: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN79870%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for NN79870: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX38493%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for VX38493: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML40438%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for ML40438: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL39626%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for LL39626: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA89683%27 HTTP/1.1" 200 None
2026-03-30 12:31:25 [auto1.fr] INFO: Scrape type for FA89683: 0
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 12:31:25 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 12:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:34 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 5773 | hits on page: 40
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA39338%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for WA39338: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ25040%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for YJ25040: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF42365%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for YF42365: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX15810%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for LX15810: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL77930%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for CL77930: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB58731%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for PB58731: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST25881%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for ST25881: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH84057%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for FH84057: 0
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 12:31:34 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN71549%27 HTTP/1.1" 200 None
2026-03-30 12:31:34 [auto1.fr] INFO: Scrape type for UN71549: 0
2026-03-30 12:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:46 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 5774 | hits on page: 40
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN71549%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for UN71549: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW24399%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for JW24399: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB64287%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for EB64287: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB45845%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for SB45845: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY91282%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for GY91282: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA28436%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for ZA28436: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN04187%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for ZN04187: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD59755%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for GD59755: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE01664%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for NE01664: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH40819%27 HTTP/1.1" 200 None
2026-03-30 12:31:46 [auto1.fr] INFO: Scrape type for RH40819: 0
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 12:31:46 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 12:31:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:50 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 5774 | hits on page: 40
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ06852%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for BJ06852: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF06933%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for SF06933: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP42909%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for GP42909: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29084%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for ZE29084: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE16259%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for KE16259: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ69212%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for WZ69212: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT48746%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for ZT48746: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL94456%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for TL94456: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK52148%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for WK52148: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG82505%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for NG82505: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY25615%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for HY25615: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM64712%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for RM64712: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB40842%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for JB40842: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ86627%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for EJ86627: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY44671%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for FY44671: 0
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 12:31:50 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS08654%27 HTTP/1.1" 200 None
2026-03-30 12:31:50 [auto1.fr] INFO: Scrape type for AS08654: 2
2026-03-30 12:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6ed9607-7c2b-5812-b3ba-89a02036305e with identifier: AS08654
2026-03-30 12:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6ed9607-7c2b-5812-b3ba-89a02036305e with scrape type 2
2026-03-30 12:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6ed9607-7c2b-5812-b3ba-89a02036305e with scrape type 2
2026-03-30 12:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d6ed9607-7c2b-5812-b3ba-89a02036305e, identifier: AS08654
2026-03-30 12:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d6ed9607-7c2b-5812-b3ba-89a02036305e with identifier: AS08654
2026-03-30 12:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d6ed9607-7c2b-5812-b3ba-89a02036305e with identifier: AS08654
2026-03-30 12:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d6ed9607-7c2b-5812-b3ba-89a02036305e with identifier: AS08654 to the API
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:25:45Z',
'fuel_type': 'petrol',
'id': 'd6ed9607-7c2b-5812-b3ba-89a02036305e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS08654',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 120298,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-14',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS08654%27 HTTP/1.1" 200 None
2026-03-30 12:31:51 [auto1.fr] INFO: Saving data for AS08654: {'auction_closing_time': 1774884345.0, 'created_time': 1774599044.65467, 'last_price_update_time': 1774873911.417176}
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS08654') HTTP/1.1" 204 0
2026-03-30 12:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:51 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 12:31:51 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 12:31:51 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 12:31:51 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW06359%27 HTTP/1.1" 200 None
2026-03-30 12:31:51 [auto1.fr] INFO: Scrape type for XW06359: 0
2026-03-30 12:31:51 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 12:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:53 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 5775 | hits on page: 40
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF96045%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for MF96045: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV97984%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for MV97984: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK39723%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for XK39723: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED77700%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for ED77700: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH36096%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for VH36096: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ55936%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for LJ55936: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF32846%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for TF32846: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW71612%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for GW71612: 0
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 12:31:53 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ02955%27 HTTP/1.1" 200 None
2026-03-30 12:31:53 [auto1.fr] INFO: Scrape type for ZZ02955: 0
2026-03-30 12:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:58 [scrapy.extensions.logstats] INFO: Crawled 270 pages (at 7 pages/min), scraped 202 items (at 1 items/min)
2026-03-30 12:31:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:01 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 5777 | hits on page: 40
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ02955%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for ZZ02955: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK20775%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for GK20775: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER73555%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for ER73555: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU62117%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for TU62117: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA37014%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for TA37014: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP31799%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for YP31799: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY33556%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for HY33556: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10256%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for TB10256: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM74290%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for FM74290: 0
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 12:32:01 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF77781%27 HTTP/1.1" 200 None
2026-03-30 12:32:01 [auto1.fr] INFO: Scrape type for HF77781: 0
2026-03-30 12:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:09 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 5778 | hits on page: 40
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF77781%27 HTTP/1.1" 200 None
2026-03-30 12:32:09 [auto1.fr] INFO: Scrape type for HF77781: 0
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS70768%27 HTTP/1.1" 200 None
2026-03-30 12:32:09 [auto1.fr] INFO: Scrape type for CS70768: 0
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ48042%27 HTTP/1.1" 200 None
2026-03-30 12:32:09 [auto1.fr] INFO: Scrape type for HZ48042: 0
2026-03-30 12:32:09 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP78358%27 HTTP/1.1" 200 None
2026-03-30 12:32:09 [auto1.fr] INFO: Scrape type for EP78358: 2
2026-03-30 12:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 975fe50a-7bee-5cb1-8428-bad460c2938d with identifier: EP78358
2026-03-30 12:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 975fe50a-7bee-5cb1-8428-bad460c2938d with scrape type 2
2026-03-30 12:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 975fe50a-7bee-5cb1-8428-bad460c2938d with scrape type 2
2026-03-30 12:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 975fe50a-7bee-5cb1-8428-bad460c2938d, identifier: EP78358
2026-03-30 12:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 975fe50a-7bee-5cb1-8428-bad460c2938d with identifier: EP78358
2026-03-30 12:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 975fe50a-7bee-5cb1-8428-bad460c2938d with identifier: EP78358
2026-03-30 12:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 975fe50a-7bee-5cb1-8428-bad460c2938d with identifier: EP78358 to the API
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:28:39Z',
'fuel_type': 'petrol',
'id': '975fe50a-7bee-5cb1-8428-bad460c2938d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP78358',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 229011,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-05-14',
'seller_name': None,
'title': 'Renault Clio 1.2 RXE',
'transmission': 'manual',
'trim': 'RXE',
'year': 2000}
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP78358%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Saving data for EP78358: {'auction_closing_time': 1774884519.0, 'created_time': 1774278767.850149, 'last_price_update_time': 1774873930.429364}
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP78358') HTTP/1.1" 204 0
2026-03-30 12:32:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR91044%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for CR91044: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH89831%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for UH89831: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE58308%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for NE58308: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY13200%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for TY13200: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU80215%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for ZU80215: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC18537%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for ZC18537: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN88696%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for ZN88696: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA22916%27 HTTP/1.1" 200 None
2026-03-30 12:32:10 [auto1.fr] INFO: Scrape type for FA22916: 0
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 12:32:10 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 12:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:11 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 5778 | hits on page: 40
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB35066%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for GB35066: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK47472%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for RK47472: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN94210%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for UN94210: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ05356%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for PJ05356: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA25140%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for TA25140: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC59558%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for GC59558: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA65750%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for JA65750: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE04668%27 HTTP/1.1" 200 None
2026-03-30 12:32:11 [auto1.fr] INFO: Scrape type for YE04668: 0
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 12:32:11 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 12:32:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:12 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 5780 | hits on page: 40
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ14554%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for BJ14554: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC87774%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for NC87774: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC53621%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for BC53621: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY05783%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for LY05783: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ28458%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for LJ28458: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL49428%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for SL49428: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN04372%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for VN04372: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY60991%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for RY60991: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW68583%27 HTTP/1.1" 200 None
2026-03-30 12:32:12 [auto1.fr] INFO: Scrape type for UW68583: 0
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 12:32:12 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 12:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:21 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 5781 | hits on page: 40
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE30008%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for KE30008: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG75683%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for JG75683: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU68790%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for GU68790: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP13872%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for SP13872: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD03445%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for WD03445: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU47329%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for HU47329: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD40979%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for XD40979: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX89795%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for NX89795: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL47975%27 HTTP/1.1" 200 None
2026-03-30 12:32:21 [auto1.fr] INFO: Scrape type for YL47975: 0
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 12:32:21 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 12:32:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:22 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 5781 | hits on page: 40
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM65355%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for LM65355: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL73709%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for RL73709: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA58884%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for PA58884: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS97923%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for BS97923: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT42068%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for KT42068: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA85068%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for YA85068: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR88609%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for SR88609: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB99343%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for WB99343: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV93418%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for FV93418: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP34263%27 HTTP/1.1" 200 None
2026-03-30 12:32:22 [auto1.fr] INFO: Scrape type for FP34263: 0
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 12:32:22 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 12:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:33 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM64733%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for CM64733: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG72682%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for NG72682: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE10352%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for FE10352: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL10728%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for VL10728: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH88652%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for MH88652: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP40813%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for YP40813: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF57055%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for FF57055: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG45775%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for XG45775: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP24838%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.fr] INFO: Scrape type for SP24838: 0
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 12:32:33 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 12:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:37 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV92378%27 HTTP/1.1" 200 None
2026-03-30 12:32:37 [auto1.fr] INFO: Scrape type for NV92378: 0
2026-03-30 12:32:37 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG07398%27 HTTP/1.1" 200 None
2026-03-30 12:32:37 [auto1.fr] INFO: Scrape type for HG07398: 2
2026-03-30 12:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with identifier: HG07398
2026-03-30 12:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with scrape type 2
2026-03-30 12:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with scrape type 2
2026-03-30 12:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6cba7ea-ea64-5d2d-ac9e-533536bd3544, identifier: HG07398
2026-03-30 12:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with identifier: HG07398
2026-03-30 12:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with identifier: HG07398
2026-03-30 12:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6cba7ea-ea64-5d2d-ac9e-533536bd3544 with identifier: HG07398 to the API
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:40Z',
'fuel_type': 'petrol',
'id': 'b6cba7ea-ea64-5d2d-ac9e-533536bd3544',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG07398',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 125922,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seller_name': None,
'title': 'Audi Q2 1.4 TFSI ACT S line',
'transmission': 'manual',
'trim': 'S line',
'year': 2018}
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG07398%27 HTTP/1.1" 200 None
2026-03-30 12:32:38 [auto1.fr] INFO: Saving data for HG07398: {'auction_closing_time': 1774883380.0, 'created_time': 1774037890.567591, 'last_price_update_time': 1774873958.805051}
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HG07398') HTTP/1.1" 204 0
2026-03-30 12:32:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX89083%27 HTTP/1.1" 200 None
2026-03-30 12:32:38 [auto1.fr] INFO: Scrape type for VX89083: 0
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP15917%27 HTTP/1.1" 200 None
2026-03-30 12:32:38 [auto1.fr] INFO: Scrape type for BP15917: 0
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY07329%27 HTTP/1.1" 200 None
2026-03-30 12:32:38 [auto1.fr] INFO: Scrape type for MY07329: 0
2026-03-30 12:32:38 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM46379%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for ZM46379: 2
2026-03-30 12:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1401c6-b3dc-539b-b6e1-037b6f40addb with identifier: ZM46379
2026-03-30 12:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1401c6-b3dc-539b-b6e1-037b6f40addb with scrape type 2
2026-03-30 12:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc1401c6-b3dc-539b-b6e1-037b6f40addb with scrape type 2
2026-03-30 12:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc1401c6-b3dc-539b-b6e1-037b6f40addb, identifier: ZM46379
2026-03-30 12:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc1401c6-b3dc-539b-b6e1-037b6f40addb with identifier: ZM46379
2026-03-30 12:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc1401c6-b3dc-539b-b6e1-037b6f40addb with identifier: ZM46379
2026-03-30 12:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc1401c6-b3dc-539b-b6e1-037b6f40addb with identifier: ZM46379 to the API
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:01Z',
'fuel_type': 'diesel',
'id': 'fc1401c6-b3dc-539b-b6e1-037b6f40addb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46379',
'listing': 'auction',
'make': 'Opel',
'model': 'Antara',
'odometer': 170842,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-09',
'seller_name': None,
'title': 'Opel Antara 2.0 CDTI Cosmo Pack',
'transmission': 'manual',
'trim': 'Cosmo Pack',
'year': 2010}
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM46379%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Saving data for ZM46379: {'auction_closing_time': 1774885501.0, 'created_time': 1774019457.137012, 'last_price_update_time': 1774873959.392487}
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZM46379') HTTP/1.1" 204 0
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF67266%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for EF67266: 0
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX38745%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for FX38745: 0
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN92934%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for BN92934: 0
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP15614%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for LP15614: 0
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 12:32:39 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV36444%27 HTTP/1.1" 200 None
2026-03-30 12:32:39 [auto1.fr] INFO: Scrape type for RV36444: 0
2026-03-30 12:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:51 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 5782 | hits on page: 40
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU96312%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for TU96312: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ01381%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for EJ01381: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW49011%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for BW49011: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN84879%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for MN84879: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ67934%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for SZ67934: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL66203%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for KL66203: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE33473%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for TE33473: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD71444%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for TD71444: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT51628%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for BT51628: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD63753%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for TD63753: 0
2026-03-30 12:32:51 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ13177%27 HTTP/1.1" 200 None
2026-03-30 12:32:51 [auto1.fr] INFO: Scrape type for FJ13177: 0
2026-03-30 12:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:58 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 5783 | hits on page: 40
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ13177%27 HTTP/1.1" 200 None
2026-03-30 12:32:58 [auto1.fr] INFO: Scrape type for FJ13177: 0
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR66280%27 HTTP/1.1" 200 None
2026-03-30 12:32:58 [auto1.fr] INFO: Scrape type for MR66280: 0
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL36376%27 HTTP/1.1" 200 None
2026-03-30 12:32:58 [auto1.fr] INFO: Scrape type for VL36376: 0
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 12:32:58 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ32121%27 HTTP/1.1" 200 None
2026-03-30 12:32:58 [auto1.fr] INFO: Scrape type for WJ32121: 2
2026-03-30 12:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b90bfc-e086-503b-b679-1f51c74652f7 with identifier: WJ32121
2026-03-30 12:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b90bfc-e086-503b-b679-1f51c74652f7 with scrape type 2
2026-03-30 12:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b90bfc-e086-503b-b679-1f51c74652f7 with scrape type 2
2026-03-30 12:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7b90bfc-e086-503b-b679-1f51c74652f7, identifier: WJ32121
2026-03-30 12:32:59 [scrapy.extensions.logstats] INFO: Crawled 280 pages (at 10 pages/min), scraped 205 items (at 3 items/min)
2026-03-30 12:32:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7b90bfc-e086-503b-b679-1f51c74652f7 with identifier: WJ32121
2026-03-30 12:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7b90bfc-e086-503b-b679-1f51c74652f7 with identifier: WJ32121
2026-03-30 12:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7b90bfc-e086-503b-b679-1f51c74652f7 with identifier: WJ32121 to the API
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:35Z',
'fuel_type': 'diesel',
'id': 'b7b90bfc-e086-503b-b679-1f51c74652f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ32121',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 163725,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-25',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro design luxe',
'transmission': 'automatic',
'trim': 'quattro design luxe',
'year': 2016}
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ32121%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Saving data for WJ32121: {'auction_closing_time': 1774886315.0, 'created_time': 1773938837.062362, 'last_price_update_time': 1774873979.320759}
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ32121') HTTP/1.1" 204 0
2026-03-30 12:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA38525%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Scrape type for HA38525: 0
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT08692%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Scrape type for TT08692: 0
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD28161%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Scrape type for WD28161: 0
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU54464%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Scrape type for VU54464: 0
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR30597%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Scrape type for MR30597: 2
2026-03-30 12:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with identifier: MR30597
2026-03-30 12:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with scrape type 2
2026-03-30 12:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with scrape type 2
2026-03-30 12:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6, identifier: MR30597
2026-03-30 12:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with identifier: MR30597
2026-03-30 12:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with identifier: MR30597
2026-03-30 12:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6 with identifier: MR30597 to the API
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:48:29Z',
'fuel_type': 'diesel',
'id': '3bc0d36c-3a65-5496-b3fe-0ac5d120a9e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR30597',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 279637,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-15',
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Feline',
'transmission': 'automatic',
'trim': 'Feline',
'year': 2012}
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR30597%27 HTTP/1.1" 200 None
2026-03-30 12:32:59 [auto1.fr] INFO: Saving data for MR30597: {'auction_closing_time': 1774885709.0, 'created_time': 1774599040.556665, 'last_price_update_time': 1774873979.893405}
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR30597') HTTP/1.1" 204 0
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 12:32:59 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN55047%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for SN55047: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ62596%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for HJ62596: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM75659%27 HTTP/1.1" 200 None
2026-03-30 12:33:00 [auto1.fr] INFO: Scrape type for NM75659: 0
2026-03-30 12:33:00 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 12:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:01 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP96074%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for KP96074: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK55434%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for HK55434: 2
2026-03-30 12:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with identifier: HK55434
2026-03-30 12:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with scrape type 2
2026-03-30 12:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with scrape type 2
2026-03-30 12:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1, identifier: HK55434
2026-03-30 12:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with identifier: HK55434
2026-03-30 12:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with identifier: HK55434
2026-03-30 12:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1 with identifier: HK55434 to the API
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:19:29Z',
'fuel_type': 'petrol',
'id': '9e57a4d1-a88f-5f28-9fd2-9f17b2d011a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK55434',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 129990,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-07',
'seller_name': None,
'title': 'Audi A5 1.8 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK55434%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Saving data for HK55434: {'auction_closing_time': 1774883969.0, 'created_time': 1773837285.231652, 'last_price_update_time': 1774873981.652631}
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK55434') HTTP/1.1" 204 0
2026-03-30 12:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA12515%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for NA12515: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM89877%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for AM89877: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL95450%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for JL95450: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM92951%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for WM92951: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE79151%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for AE79151: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU18877%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for VU18877: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC47283%27 HTTP/1.1" 200 None
2026-03-30 12:33:01 [auto1.fr] INFO: Scrape type for RC47283: 0
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 12:33:01 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 12:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:08 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH59532%27 HTTP/1.1" 200 None
2026-03-30 12:33:08 [auto1.fr] INFO: Scrape type for LH59532: 0
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ25603%27 HTTP/1.1" 200 None
2026-03-30 12:33:08 [auto1.fr] INFO: Scrape type for YZ25603: 0
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV44843%27 HTTP/1.1" 200 None
2026-03-30 12:33:08 [auto1.fr] INFO: Scrape type for LV44843: 0
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR21211%27 HTTP/1.1" 200 None
2026-03-30 12:33:08 [auto1.fr] INFO: Scrape type for AR21211: 0
2026-03-30 12:33:08 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB89018%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.fr] INFO: Scrape type for WB89018: 0
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU48556%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.fr] INFO: Scrape type for LU48556: 0
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL55283%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.fr] INFO: Scrape type for NL55283: 0
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT87055%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.fr] INFO: Scrape type for BT87055: 0
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 12:33:09 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ96194%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.fr] INFO: Scrape type for NJ96194: 0
2026-03-30 12:33:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:11 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU55981%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for UU55981: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX48416%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for FX48416: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR10401%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for MR10401: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ84234%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for PZ84234: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS84843%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for XS84843: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL24747%27 HTTP/1.1" 200 None
2026-03-30 12:33:11 [auto1.fr] INFO: Scrape type for PL24747: 0
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 12:33:11 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 12:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:15 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL90015%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for HL90015: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL76778%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for UL76778: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT00764%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for RT00764: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG69928%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for GG69928: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK42079%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for DK42079: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT44100%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for CT44100: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE44996%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for LE44996: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW69865%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for DW69865: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP86966%27 HTTP/1.1" 200 None
2026-03-30 12:33:15 [auto1.fr] INFO: Scrape type for SP86966: 0
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 12:33:15 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 12:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:16 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 12:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR92186%27 HTTP/1.1" 200 None
2026-03-30 12:33:16 [auto1.fr] INFO: Scrape type for WR92186: 0
2026-03-30 12:33:16 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 12:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU78733%27 HTTP/1.1" 200 None
2026-03-30 12:33:16 [auto1.fr] INFO: Scrape type for FU78733: 2
2026-03-30 12:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with identifier: FU78733
2026-03-30 12:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with scrape type 2
2026-03-30 12:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with scrape type 2
2026-03-30 12:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 599468cb-307b-5ced-a8d3-8f5b4a3ea18b, identifier: FU78733
2026-03-30 12:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with identifier: FU78733
2026-03-30 12:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with identifier: FU78733
2026-03-30 12:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 599468cb-307b-5ced-a8d3-8f5b4a3ea18b with identifier: FU78733 to the API
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:53:19Z',
'fuel_type': 'diesel',
'id': '599468cb-307b-5ced-a8d3-8f5b4a3ea18b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU78733',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 179490,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-11',
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2020}
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU78733%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Saving data for FU78733: {'auction_closing_time': 1774885999.0, 'created_time': 1773254868.975891, 'last_price_update_time': 1774873997.418001}
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FU78733') HTTP/1.1" 204 0
2026-03-30 12:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ39166%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for SJ39166: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES34117%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for ES34117: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE69927%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for GE69927: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG76668%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for HG76668: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC55884%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for VC55884: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV07911%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for PV07911: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY56307%27 HTTP/1.1" 200 None
2026-03-30 12:33:17 [auto1.fr] INFO: Scrape type for WY56307: 0
2026-03-30 12:33:17 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 12:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:25 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW18098%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for LW18098: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB71354%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for CB71354: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC87969%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for WC87969: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY32232%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for XY32232: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ10910%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for AZ10910: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL35493%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for DL35493: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA58799%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for GA58799: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF65222%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for SF65222: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX98635%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for BX98635: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU82775%27 HTTP/1.1" 200 None
2026-03-30 12:33:25 [auto1.fr] INFO: Scrape type for GU82775: 0
2026-03-30 12:33:25 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 12:33:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:26 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU64752%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for VU64752: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ05969%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for LZ05969: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF54292%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for DF54292: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB66651%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for FB66651: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX62371%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for XX62371: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21359%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for GM21359: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA98914%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for CA98914: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY10481%27 HTTP/1.1" 200 None
2026-03-30 12:33:26 [auto1.fr] INFO: Scrape type for CY10481: 0
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 12:33:26 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 12:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:28 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 5783 | hits on page: 40
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT65594%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for AT65594: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY61677%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for GY61677: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA93142%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for GA93142: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX78673%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for CX78673: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC24072%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for CC24072: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB09337%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for YB09337: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL03444%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for UL03444: 0
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 12:33:28 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW37047%27 HTTP/1.1" 200 None
2026-03-30 12:33:28 [auto1.fr] INFO: Scrape type for AW37047: 2
2026-03-30 12:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 986543ec-1d01-5e42-8d23-60ce01da20c9 with identifier: AW37047
2026-03-30 12:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 986543ec-1d01-5e42-8d23-60ce01da20c9 with scrape type 2
2026-03-30 12:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 986543ec-1d01-5e42-8d23-60ce01da20c9 with scrape type 2
2026-03-30 12:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 986543ec-1d01-5e42-8d23-60ce01da20c9, identifier: AW37047
2026-03-30 12:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 986543ec-1d01-5e42-8d23-60ce01da20c9 with identifier: AW37047
2026-03-30 12:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 986543ec-1d01-5e42-8d23-60ce01da20c9 with identifier: AW37047
2026-03-30 12:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 986543ec-1d01-5e42-8d23-60ce01da20c9 with identifier: AW37047 to the API
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:53Z',
'fuel_type': 'diesel',
'id': '986543ec-1d01-5e42-8d23-60ce01da20c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW37047',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 230594,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-02',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.6 JTD Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2015}
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW37047%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Saving data for AW37047: {'auction_closing_time': 1774885673.0, 'created_time': 1773389731.377163, 'last_price_update_time': 1774874009.329723}
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW37047') HTTP/1.1" 204 0
2026-03-30 12:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR99275%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Scrape type for GR99275: 0
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV42623%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Scrape type for EV42623: 0
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS35351%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Scrape type for WS35351: 0
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT20468%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Scrape type for VT20468: 0
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH60599%27 HTTP/1.1" 200 None
2026-03-30 12:33:29 [auto1.fr] INFO: Scrape type for KH60599: 0
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 12:33:29 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 12:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:38 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 5785 | hits on page: 40
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS07916%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for FS07916: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU95789%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for MU95789: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA15560%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for FA15560: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX42017%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for YX42017: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB85686%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for XB85686: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG49847%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for SG49847: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP86931%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for MP86931: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE28415%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for BE28415: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF06741%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for FF06741: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ11601%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for KJ11601: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB90662%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for TB90662: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW72790%27 HTTP/1.1" 200 None
2026-03-30 12:33:38 [auto1.fr] INFO: Scrape type for AW72790: 0
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 12:33:38 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB06410%27 HTTP/1.1" 200 None
2026-03-30 12:33:39 [auto1.fr] INFO: Scrape type for VB06410: 0
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU33968%27 HTTP/1.1" 200 None
2026-03-30 12:33:39 [auto1.fr] INFO: Scrape type for TU33968: 0
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU24416%27 HTTP/1.1" 200 None
2026-03-30 12:33:39 [auto1.fr] INFO: Scrape type for KU24416: 0
2026-03-30 12:33:39 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 12:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:45 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 5786 | hits on page: 40
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU68644%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for BU68644: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF00232%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for AF00232: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM89267%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for AM89267: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN35398%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for AN35398: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS11031%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for SS11031: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF99764%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for EF99764: 0
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 12:33:45 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH53651%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.fr] INFO: Scrape type for FH53651: 0
2026-03-30 12:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:58 [scrapy.extensions.logstats] INFO: Crawled 290 pages (at 10 pages/min), scraped 210 items (at 5 items/min)
2026-03-30 12:33:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:22 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 5788 | hits on page: 40
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH53651%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for FH53651: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW75527%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for VW75527: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT70639%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for WT70639: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK17800%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for TK17800: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL23162%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for SL23162: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH72856%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for LH72856: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP87670%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for UP87670: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL19117%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for HL19117: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE12504%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for XE12504: 0
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 12:34:22 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN28845%27 HTTP/1.1" 200 None
2026-03-30 12:34:22 [auto1.fr] INFO: Scrape type for BN28845: 0
2026-03-30 12:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:24 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 5788 | hits on page: 40
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH22765%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for TH22765: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM49151%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for GM49151: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH66177%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for NH66177: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF71559%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for AF71559: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN93682%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for LN93682: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM63454%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for XM63454: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK60442%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for BK60442: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY19911%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for FY19911: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV66666%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for UV66666: 0
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 12:34:24 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD62088%27 HTTP/1.1" 200 None
2026-03-30 12:34:24 [auto1.fr] INFO: Scrape type for TD62088: 0
2026-03-30 12:34:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:58 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 2 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:34:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:47 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 5796 | hits on page: 40
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV66666%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for UV66666: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD62088%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for TD62088: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC75279%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for DC75279: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL06807%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for XL06807: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT76332%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for TT76332: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY53867%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for GY53867: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF80120%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for EF80120: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK90535%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for SK90535: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG41079%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for WG41079: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA75396%27 HTTP/1.1" 200 None
2026-03-30 12:35:47 [auto1.fr] INFO: Scrape type for HA75396: 0
2026-03-30 12:35:47 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 12:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:58 [scrapy.extensions.logstats] INFO: Crawled 293 pages (at 1 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:35:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:23 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 5798 | hits on page: 40
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA75396%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for HA75396: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH82966%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for EH82966: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF11578%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for CF11578: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF04067%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for MF04067: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE18245%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for EE18245: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ01678%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for JZ01678: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP14970%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for TP14970: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW34119%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for EW34119: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF12969%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for NF12969: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW04315%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for EW04315: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC95950%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for GC95950: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM04559%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for DM04559: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS09336%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for SS09336: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU31753%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for WU31753: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG22146%27 HTTP/1.1" 200 None
2026-03-30 12:36:23 [auto1.fr] INFO: Scrape type for LG22146: 0
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 12:36:23 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 12:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:28 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 5798 | hits on page: 40
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW26107%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for TW26107: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ75566%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for MJ75566: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD63756%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for ZD63756: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV97892%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for SV97892: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU45612%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for CU45612: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ88065%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for UZ88065: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX46550%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for BX46550: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF96093%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for BF96093: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED65991%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for ED65991: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR66239%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for DR66239: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF98972%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for DF98972: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV80375%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for UV80375: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB33898%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for JB33898: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT70667%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for MT70667: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK69407%27 HTTP/1.1" 200 None
2026-03-30 12:36:28 [auto1.fr] INFO: Scrape type for BK69407: 0
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 12:36:28 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 12:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:58 [scrapy.extensions.logstats] INFO: Crawled 295 pages (at 2 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:36:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:01 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU21313%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for FU21313: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG53313%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for CG53313: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF28625%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for FF28625: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB99079%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for XB99079: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT56886%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for RT56886: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU00090%27 HTTP/1.1" 200 None
2026-03-30 12:37:01 [auto1.fr] INFO: Scrape type for PU00090: 0
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 12:37:01 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 12:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:02 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML04615%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for ML04615: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV80485%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for AV80485: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN29658%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for CN29658: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW84487%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for WW84487: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP20801%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for JP20801: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD24187%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for CD24187: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD66750%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for ZD66750: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC58365%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for GC58365: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM06059%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for PM06059: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF63220%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for XF63220: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG51030%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.fr] INFO: Scrape type for EG51030: 0
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 12:37:02 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB25032%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.fr] INFO: Scrape type for LB25032: 0
2026-03-30 12:37:03 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 12:37:03 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG65710%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.fr] INFO: Scrape type for CG65710: 0
2026-03-30 12:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:05 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD68300%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for YD68300: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM53873%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for GM53873: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK37382%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for CK37382: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV53313%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for KV53313: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL86896%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for CL86896: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX10882%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for KX10882: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF55274%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for LF55274: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD92116%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for AD92116: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE38558%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for FE38558: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA12460%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for MA12460: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF28461%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for FF28461: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN50760%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for RN50760: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG75134%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.fr] INFO: Scrape type for ZG75134: 0
2026-03-30 12:37:05 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 12:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:11 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX41786%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for AX41786: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS77345%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for AS77345: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL13370%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for FL13370: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP67639%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for LP67639: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL88794%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for RL88794: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY73835%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for AY73835: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN08668%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.fr] INFO: Scrape type for RN08668: 0
2026-03-30 12:37:11 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 12:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:12 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA95461%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for XA95461: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX43291%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for MX43291: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ35871%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for KJ35871: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG59474%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for GG59474: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF72416%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for WF72416: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX99023%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for WX99023: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF38557%27 HTTP/1.1" 200 None
2026-03-30 12:37:12 [auto1.fr] INFO: Scrape type for CF38557: 0
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 12:37:12 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 12:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:14 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 5798 | hits on page: 40
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR08290%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for GR08290: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD28531%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for MD28531: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF14495%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for PF14495: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ50312%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for LJ50312: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD20720%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for FD20720: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT64778%27 HTTP/1.1" 200 None
2026-03-30 12:37:14 [auto1.fr] INFO: Scrape type for CT64778: 0
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 12:37:14 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 12:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:58 [scrapy.extensions.logstats] INFO: Crawled 301 pages (at 6 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:37:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:28 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 5803 | hits on page: 40
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT64778%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for CT64778: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT59073%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for MT59073: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR47486%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for AR47486: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG62052%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for RG62052: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN77575%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for KN77575: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL52009%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for HL52009: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY17204%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for JY17204: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG97173%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for HG97173: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB65012%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for DB65012: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD25413%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for LD25413: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT08625%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.fr] INFO: Scrape type for NT08625: 0
2026-03-30 12:38:28 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 12:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:36 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 5803 | hits on page: 40
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ66470%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for UJ66470: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV56232%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for SV56232: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW32775%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for AW32775: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL16549%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for HL16549: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC47215%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for JC47215: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW28110%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for UW28110: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS84170%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for FS84170: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ61951%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.fr] INFO: Scrape type for LJ61951: 0
2026-03-30 12:38:36 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 12:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:41 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 5803 | hits on page: 40
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM07469%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for MM07469: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT66619%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for MT66619: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC30753%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for WC30753: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL10414%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for FL10414: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE03107%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for RE03107: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD96168%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for UD96168: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG81278%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for CG81278: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN81957%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for WN81957: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG56079%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for GG56079: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK84670%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for SK84670: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN65579%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for CN65579: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72019%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.fr] INFO: Scrape type for CT72019: 0
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 12:38:41 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 12:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:58 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 3 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:38:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:39:58 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 0 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:39:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:40:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.886(s), this was the 1st time calling it.
2026-03-30 12:40:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.615546033359942 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:40:58 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 0 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:40:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:41:58 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 0 pages/min), scraped 210 items (at 0 items/min)
2026-03-30 12:41:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:42:12 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 5820 | hits on page: 40
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG81278%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for CG81278: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN81957%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for WN81957: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG56079%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for GG56079: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK84670%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for SK84670: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN65579%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for CN65579: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72019%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for CT72019: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY57064%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for UY57064: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA04044%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for TA04044: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH87335%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for NH87335: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS15455%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for PS15455: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY63151%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for FY63151: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV80653%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for TV80653: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA15271%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for FA15271: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY03331%27 HTTP/1.1" 200 None
2026-03-30 12:42:12 [auto1.fr] INFO: Scrape type for YY03331: 0
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 12:42:12 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 12:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:42:17 [auto1.fr] INFO: Channel: 24h | Page: 102 | totalHits: 5820 | hits on page: 40
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW60229%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for LW60229: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ71973%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for TZ71973: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP81019%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for YP81019: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM90581%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for DM90581: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW26856%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for EW26856: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ70913%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for MZ70913: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL78382%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for SL78382: 0
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 12:42:17 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU07698%27 HTTP/1.1" 200 None
2026-03-30 12:42:17 [auto1.fr] INFO: Scrape type for DU07698: 2
2026-03-30 12:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3030537-30a7-5dec-80eb-818d516fbad2 with identifier: DU07698
2026-03-30 12:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3030537-30a7-5dec-80eb-818d516fbad2 with scrape type 2
2026-03-30 12:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3030537-30a7-5dec-80eb-818d516fbad2 with scrape type 2
2026-03-30 12:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e3030537-30a7-5dec-80eb-818d516fbad2, identifier: DU07698
2026-03-30 12:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e3030537-30a7-5dec-80eb-818d516fbad2 with identifier: DU07698
2026-03-30 12:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e3030537-30a7-5dec-80eb-818d516fbad2 with identifier: DU07698
2026-03-30 12:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e3030537-30a7-5dec-80eb-818d516fbad2 with identifier: DU07698 to the API
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:55Z',
'fuel_type': 'petrol',
'id': 'e3030537-30a7-5dec-80eb-818d516fbad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU07698',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 63224,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-27',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2020}
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU07698%27 HTTP/1.1" 200 None
2026-03-30 12:42:18 [auto1.fr] INFO: Saving data for DU07698: {'auction_closing_time': 1774885135.0, 'created_time': 1774599037.506498, 'last_price_update_time': 1774874538.249407}
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DU07698') HTTP/1.1" 204 0
2026-03-30 12:42:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND01459%27 HTTP/1.1" 200 None
2026-03-30 12:42:18 [auto1.fr] INFO: Scrape type for ND01459: 0
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65049%27 HTTP/1.1" 200 None
2026-03-30 12:42:18 [auto1.fr] INFO: Scrape type for NK65049: 0
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ08145%27 HTTP/1.1" 200 None
2026-03-30 12:42:18 [auto1.fr] INFO: Scrape type for YJ08145: 0
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 12:42:18 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77834%27 HTTP/1.1" 200 None
2026-03-30 12:42:18 [auto1.fr] INFO: Scrape type for LL77834: 0
2026-03-30 12:42:58 [scrapy.extensions.logstats] INFO: Crawled 306 pages (at 2 pages/min), scraped 211 items (at 1 items/min)
2026-03-30 12:42:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:43:58 [scrapy.extensions.logstats] INFO: Crawled 306 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:43:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:44:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.176(s), this was the 1st time calling it.
2026-03-30 12:44:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.174979674434391 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:44:34 [auto1.fr] INFO: Channel: 24h | Page: 103 | totalHits: 5835 | hits on page: 40
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW26856%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for EW26856: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ70913%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for MZ70913: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL78382%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for SL78382: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU07698%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for DU07698: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND01459%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for ND01459: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65049%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for NK65049: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ08145%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for YJ08145: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77834%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for LL77834: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC74566%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for UC74566: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY84423%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for CY84423: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH20773%27 HTTP/1.1" 200 None
2026-03-30 12:44:34 [auto1.fr] INFO: Scrape type for DH20773: 0
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 12:44:34 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 12:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:44:58 [scrapy.extensions.logstats] INFO: Crawled 307 pages (at 1 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:44:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:45:58 [scrapy.extensions.logstats] INFO: Crawled 307 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:45:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:46:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.207(s), this was the 1st time calling it.
2026-03-30 12:46:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.650994321351787 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:46:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:46:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:46:53 [auto1.fr] INFO: Channel: 24h | Page: 104 | totalHits: 5849 | hits on page: 40
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY84423%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for CY84423: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH20773%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for DH20773: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF47862%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for VF47862: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY33007%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for UY33007: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD06239%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for KD06239: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM76244%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for MM76244: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK41306%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for WK41306: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ15466%27 HTTP/1.1" 200 None
2026-03-30 12:46:53 [auto1.fr] INFO: Scrape type for PJ15466: 0
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 12:46:53 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 12:46:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:46:58 [scrapy.extensions.logstats] INFO: Crawled 308 pages (at 1 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:46:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:47:58 [scrapy.extensions.logstats] INFO: Crawled 308 pages (at 0 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:47:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:48:04 [auto1.fr] INFO: Channel: 24h | Page: 105 | totalHits: 5857 | hits on page: 40
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM76244%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for MM76244: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK41306%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for WK41306: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ15466%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for PJ15466: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR89860%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for XR89860: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN21149%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for VN21149: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS46246%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for ZS46246: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG61465%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for EG61465: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF55114%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for RF55114: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP43967%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for AP43967: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD10490%27 HTTP/1.1" 200 None
2026-03-30 12:48:04 [auto1.fr] INFO: Scrape type for MD10490: 0
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 12:48:04 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 12:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:48:15 [auto1.fr] INFO: Channel: 24h | Page: 106 | totalHits: 5859 | hits on page: 40
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD43481%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for RD43481: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH31611%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for EH31611: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT38634%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for AT38634: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR91424%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for RR91424: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM65342%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for NM65342: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP19309%27 HTTP/1.1" 200 None
2026-03-30 12:48:15 [auto1.fr] INFO: Scrape type for EP19309: 0
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 12:48:15 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 12:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ13192%27 HTTP/1.1" 200 None
2026-03-30 12:48:16 [auto1.fr] INFO: Scrape type for GJ13192: 0
2026-03-30 12:48:16 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED04570%27 HTTP/1.1" 200 None
2026-03-30 12:48:16 [auto1.fr] INFO: Scrape type for ED04570: 0
2026-03-30 12:48:16 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 12:48:16 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU91733%27 HTTP/1.1" 200 None
2026-03-30 12:48:16 [auto1.fr] INFO: Scrape type for TU91733: 0
2026-03-30 12:48:16 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML23604%27 HTTP/1.1" 200 None
2026-03-30 12:48:16 [auto1.fr] INFO: Scrape type for ML23604: 0
2026-03-30 12:48:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:48:48 [auto1.fr] INFO: Channel: 24h | Page: 107 | totalHits: 5861 | hits on page: 40
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU91733%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for TU91733: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML23604%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for ML23604: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK36476%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for DK36476: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL80852%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for CL80852: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY73935%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for ZY73935: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX76531%27 HTTP/1.1" 200 None
2026-03-30 12:48:48 [auto1.fr] INFO: Scrape type for FX76531: 0
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 12:48:48 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 12:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY75647%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for JY75647: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL67560%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for DL67560: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG57350%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for YG57350: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA59848%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for SA59848: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR98478%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for MR98478: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB23071%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for UB23071: 0
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 12:48:49 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS33874%27 HTTP/1.1" 200 None
2026-03-30 12:48:49 [auto1.fr] INFO: Scrape type for RS33874: 0
2026-03-30 12:48:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:48:57 [auto1.fr] INFO: Channel: 24h | Page: 108 | totalHits: 5861 | hits on page: 40
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP36699%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for FP36699: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH19004%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for FH19004: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ00737%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for DJ00737: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC49171%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for NC49171: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM51224%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for AM51224: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC06822%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for DC06822: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH41528%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for VH41528: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU34225%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for EU34225: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD50705%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for XD50705: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT11394%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for XT11394: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ93131%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for CZ93131: 0
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 12:48:57 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG33724%27 HTTP/1.1" 200 None
2026-03-30 12:48:57 [auto1.fr] INFO: Scrape type for SG33724: 0
2026-03-30 12:48:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:48:58 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 4 pages/min), scraped 211 items (at 0 items/min)
2026-03-30 12:48:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:01 [auto1.fr] INFO: Channel: 24h | Page: 109 | totalHits: 5861 | hits on page: 40
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 12:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK84103%27 HTTP/1.1" 200 None
2026-03-30 12:49:01 [auto1.fr] INFO: Scrape type for ZK84103: 0
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 12:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX42794%27 HTTP/1.1" 200 None
2026-03-30 12:49:01 [auto1.fr] INFO: Scrape type for BX42794: 0
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 12:49:01 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ69538%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for CZ69538: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG94455%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for TG94455: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR03169%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for PR03169: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM69167%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for VM69167: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC20404%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for WC20404: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ90683%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for MZ90683: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS06698%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for BS06698: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM50741%27 HTTP/1.1" 200 None
2026-03-30 12:49:02 [auto1.fr] INFO: Scrape type for EM50741: 0
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 12:49:02 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 12:49:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:13 [auto1.fr] INFO: Channel: 24h | Page: 110 | totalHits: 5862 | hits on page: 40
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW27990%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for XW27990: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ55712%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for SJ55712: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR69838%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for XR69838: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP68877%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for CP68877: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB96343%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for YB96343: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG36173%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for ZG36173: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS55232%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for GS55232: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH88430%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for KH88430: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY88686%27 HTTP/1.1" 200 None
2026-03-30 12:49:13 [auto1.fr] INFO: Scrape type for DY88686: 0
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 12:49:13 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 12:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS52687%27 HTTP/1.1" 200 None
2026-03-30 12:49:14 [auto1.fr] INFO: Scrape type for YS52687: 0
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN62096%27 HTTP/1.1" 200 None
2026-03-30 12:49:14 [auto1.fr] INFO: Scrape type for BN62096: 0
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS70158%27 HTTP/1.1" 200 None
2026-03-30 12:49:14 [auto1.fr] INFO: Scrape type for BS70158: 0
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG85717%27 HTTP/1.1" 200 None
2026-03-30 12:49:14 [auto1.fr] INFO: Scrape type for AG85717: 0
2026-03-30 12:49:14 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 12:49:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:15 [auto1.fr] INFO: Channel: 24h | Page: 111 | totalHits: 5862 | hits on page: 40
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB88268%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for HB88268: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR98715%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for RR98715: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ43302%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for RZ43302: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW15397%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for GW15397: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB04765%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for MB04765: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN19759%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for JN19759: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV67556%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for AV67556: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD97133%27 HTTP/1.1" 200 None
2026-03-30 12:49:15 [auto1.fr] INFO: Scrape type for WD97133: 0
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 12:49:15 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 12:49:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:36 [auto1.fr] INFO: Channel: 24h | Page: 112 | totalHits: 5863 | hits on page: 40
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 12:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP15494%27 HTTP/1.1" 200 None
2026-03-30 12:49:36 [auto1.fr] INFO: Scrape type for WP15494: 0
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 12:49:36 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC11920%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for ZC11920: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF39125%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for DF39125: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK72589%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for JK72589: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV60888%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for HV60888: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM11789%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for FM11789: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG19413%27 HTTP/1.1" 200 None
2026-03-30 12:49:37 [auto1.fr] INFO: Scrape type for RG19413: 0
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 12:49:37 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 12:49:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:39 [auto1.fr] INFO: Channel: 24h | Page: 113 | totalHits: 5863 | hits on page: 40
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE74240%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for RE74240: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU57774%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for HU57774: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX41600%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for FX41600: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK36694%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for WK36694: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML21708%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for ML21708: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM22913%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for BM22913: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE27971%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for EE27971: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC71268%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for EC71268: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG41241%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for RG41241: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH33733%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for SH33733: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ19131%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for BJ19131: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA59957%27 HTTP/1.1" 200 None
2026-03-30 12:49:39 [auto1.fr] INFO: Scrape type for WA59957: 0
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 12:49:39 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 12:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:40 [auto1.fr] INFO: Channel: 24h | Page: 114 | totalHits: 5863 | hits on page: 40
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 12:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY32914%27 HTTP/1.1" 200 None
2026-03-30 12:49:40 [auto1.fr] INFO: Scrape type for VY32914: 0
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 12:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL69996%27 HTTP/1.1" 200 None
2026-03-30 12:49:40 [auto1.fr] INFO: Scrape type for ZL69996: 0
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 12:49:40 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER23883%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for ER23883: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV63731%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for ZV63731: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE39904%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for WE39904: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS91891%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for HS91891: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA44919%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for DA44919: 2
2026-03-30 12:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1be839-5236-58a8-9b39-906cdaa5cd72 with identifier: DA44919
2026-03-30 12:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1be839-5236-58a8-9b39-906cdaa5cd72 with scrape type 2
2026-03-30 12:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1be839-5236-58a8-9b39-906cdaa5cd72 with scrape type 2
2026-03-30 12:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a1be839-5236-58a8-9b39-906cdaa5cd72, identifier: DA44919
2026-03-30 12:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a1be839-5236-58a8-9b39-906cdaa5cd72 with identifier: DA44919
2026-03-30 12:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a1be839-5236-58a8-9b39-906cdaa5cd72 with identifier: DA44919
2026-03-30 12:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a1be839-5236-58a8-9b39-906cdaa5cd72 with identifier: DA44919 to the API
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 398,
'expiration_date': '2026-03-30T15:06:11Z',
'fuel_type': 'hybrid',
'id': '2a1be839-5236-58a8-9b39-906cdaa5cd72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44919',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 20854,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Plus Bright AWD',
'transmission': 'automatic',
'trim': 'Plus Bright AWD',
'year': 2022}
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA44919%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Saving data for DA44919: {'auction_closing_time': 1774883171.0, 'created_time': 1773219168.83852, 'last_price_update_time': 1774874981.656191}
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA44919') HTTP/1.1" 204 0
2026-03-30 12:49:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB87490%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for CB87490: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH08940%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for FH08940: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY07006%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for EY07006: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL00356%27 HTTP/1.1" 200 None
2026-03-30 12:49:41 [auto1.fr] INFO: Scrape type for VL00356: 0
2026-03-30 12:49:41 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 12:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:49:43 [auto1.fr] INFO: Channel: 24h | Page: 115 | totalHits: 5864 | hits on page: 40
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX84994%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for UX84994: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY14821%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for YY14821: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB53057%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for KB53057: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF64734%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for RF64734: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU24714%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for FU24714: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF44343%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for SF44343: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL47384%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for BL47384: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP45146%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for CP45146: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL91596%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for UL91596: 0
2026-03-30 12:49:43 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR78214%27 HTTP/1.1" 200 None
2026-03-30 12:49:43 [auto1.fr] INFO: Scrape type for SR78214: 2
2026-03-30 12:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with identifier: SR78214
2026-03-30 12:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with scrape type 2
2026-03-30 12:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with scrape type 2
2026-03-30 12:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75, identifier: SR78214
2026-03-30 12:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with identifier: SR78214
2026-03-30 12:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with identifier: SR78214
2026-03-30 12:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1400ebeb-3fd5-57d4-8cc6-9dabf63cba75 with identifier: SR78214 to the API
2026-03-30 12:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:39:50Z',
'fuel_type': 'diesel',
'id': '1400ebeb-3fd5-57d4-8cc6-9dabf63cba75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR78214',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 217536,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2016}
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR78214%27 HTTP/1.1" 200 None
2026-03-30 12:49:44 [auto1.fr] INFO: Saving data for SR78214: {'auction_closing_time': 1774885190.0, 'created_time': 1774599039.585559, 'last_price_update_time': 1774874984.860062}
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR78214') HTTP/1.1" 204 0
2026-03-30 12:49:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:49:44 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 12:49:44 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL99392%27 HTTP/1.1" 200 None
2026-03-30 12:49:44 [auto1.fr] INFO: Scrape type for SL99392: 0
2026-03-30 12:49:44 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 12:49:44 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 12:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF85427%27 HTTP/1.1" 200 None
2026-03-30 12:49:45 [auto1.fr] INFO: Scrape type for XF85427: 0
2026-03-30 12:49:58 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 7 pages/min), scraped 213 items (at 2 items/min)
2026-03-30 12:49:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:50:21 [auto1.fr] INFO: Channel: 24h | Page: 116 | totalHits: 5871 | hits on page: 40
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL91596%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for UL91596: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR78214%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for SR78214: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL99392%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for SL99392: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF85427%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for XF85427: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG44888%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for CG44888: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV16444%27 HTTP/1.1" 200 None
2026-03-30 12:50:21 [auto1.fr] INFO: Scrape type for UV16444: 0
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 12:50:21 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC43521%27 HTTP/1.1" 200 None
2026-03-30 12:50:22 [auto1.fr] INFO: Scrape type for TC43521: 0
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW06582%27 HTTP/1.1" 200 None
2026-03-30 12:50:22 [auto1.fr] INFO: Scrape type for AW06582: 0
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM45033%27 HTTP/1.1" 200 None
2026-03-30 12:50:22 [auto1.fr] INFO: Scrape type for LM45033: 0
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR53691%27 HTTP/1.1" 200 None
2026-03-30 12:50:22 [auto1.fr] INFO: Scrape type for JR53691: 0
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 12:50:22 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 12:50:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:50:24 [auto1.fr] INFO: Channel: 24h | Page: 117 | totalHits: 5871 | hits on page: 40
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF97792%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for HF97792: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET93179%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for ET93179: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL42720%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for WL42720: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM26560%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for DM26560: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT87850%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for XT87850: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC23739%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for NC23739: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK11371%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for RK11371: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM45990%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for VM45990: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC46010%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for LC46010: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE21844%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for VE21844: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW75721%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for FW75721: 0
2026-03-30 12:50:24 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC97649%27 HTTP/1.1" 200 None
2026-03-30 12:50:24 [auto1.fr] INFO: Scrape type for KC97649: 2
2026-03-30 12:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d9a37b-98e6-593a-b0e6-37b60969166d with identifier: KC97649
2026-03-30 12:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d9a37b-98e6-593a-b0e6-37b60969166d with scrape type 2
2026-03-30 12:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d9a37b-98e6-593a-b0e6-37b60969166d with scrape type 2
2026-03-30 12:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f9d9a37b-98e6-593a-b0e6-37b60969166d, identifier: KC97649
2026-03-30 12:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f9d9a37b-98e6-593a-b0e6-37b60969166d with identifier: KC97649
2026-03-30 12:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f9d9a37b-98e6-593a-b0e6-37b60969166d with identifier: KC97649
2026-03-30 12:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f9d9a37b-98e6-593a-b0e6-37b60969166d with identifier: KC97649 to the API
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:27:30Z',
'fuel_type': 'petrol',
'id': 'f9d9a37b-98e6-593a-b0e6-37b60969166d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC97649',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 121772,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-25',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Helly Hansen',
'transmission': 'manual',
'trim': 'Helly Hansen',
'year': 2014}
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC97649%27 HTTP/1.1" 200 None
2026-03-30 12:50:25 [auto1.fr] INFO: Saving data for KC97649: {'auction_closing_time': 1774884450.0, 'created_time': 1773761802.106882, 'last_price_update_time': 1774875025.348583}
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC97649') HTTP/1.1" 204 0
2026-03-30 12:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP32037%27 HTTP/1.1" 200 None
2026-03-30 12:50:25 [auto1.fr] INFO: Scrape type for HP32037: 0
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV30159%27 HTTP/1.1" 200 None
2026-03-30 12:50:25 [auto1.fr] INFO: Scrape type for FV30159: 0
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 12:50:25 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM32264%27 HTTP/1.1" 200 None
2026-03-30 12:50:25 [auto1.fr] INFO: Scrape type for YM32264: 0
2026-03-30 12:50:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:50:33 [auto1.fr] INFO: Channel: 24h | Page: 118 | totalHits: 5873 | hits on page: 40
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM32264%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for YM32264: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ12396%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for AZ12396: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY82618%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for GY82618: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR09269%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for GR09269: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY18278%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for YY18278: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ67013%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for ZZ67013: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP31918%27 HTTP/1.1" 200 None
2026-03-30 12:50:33 [auto1.fr] INFO: Scrape type for UP31918: 0
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 12:50:33 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP37519%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for HP37519: 0
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR21898%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for FR21898: 0
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ82631%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for CZ82631: 0
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH93071%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for BH93071: 0
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC39460%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for JC39460: 0
2026-03-30 12:50:34 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE96742%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Scrape type for DE96742: 2
2026-03-30 12:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 038f73d8-b7bf-5ad5-850f-1212b5856993 with identifier: DE96742
2026-03-30 12:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 038f73d8-b7bf-5ad5-850f-1212b5856993 with scrape type 2
2026-03-30 12:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 038f73d8-b7bf-5ad5-850f-1212b5856993 with scrape type 2
2026-03-30 12:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 038f73d8-b7bf-5ad5-850f-1212b5856993, identifier: DE96742
2026-03-30 12:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 038f73d8-b7bf-5ad5-850f-1212b5856993 with identifier: DE96742
2026-03-30 12:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 038f73d8-b7bf-5ad5-850f-1212b5856993 with identifier: DE96742
2026-03-30 12:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 038f73d8-b7bf-5ad5-850f-1212b5856993 with identifier: DE96742 to the API
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:29:30Z',
'fuel_type': 'diesel',
'id': '038f73d8-b7bf-5ad5-850f-1212b5856993',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE96742',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 205188,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-22',
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2015}
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE96742%27 HTTP/1.1" 200 None
2026-03-30 12:50:34 [auto1.fr] INFO: Saving data for DE96742: {'auction_closing_time': 1774884570.0, 'created_time': 1773933616.183754, 'last_price_update_time': 1774875034.525187}
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DE96742') HTTP/1.1" 204 0
2026-03-30 12:50:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:50:35 [auto1.fr] INFO: Channel: 24h | Page: 119 | totalHits: 5873 | hits on page: 40
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 12:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL19130%27 HTTP/1.1" 200 None
2026-03-30 12:50:35 [auto1.fr] INFO: Scrape type for BL19130: 0
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 12:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY43858%27 HTTP/1.1" 200 None
2026-03-30 12:50:35 [auto1.fr] INFO: Scrape type for MY43858: 0
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 12:50:35 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 12:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA49017%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for ZA49017: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR39928%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for TR39928: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK04922%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for TK04922: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH55125%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for XH55125: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL57074%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for GL57074: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT66374%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for VT66374: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS67726%27 HTTP/1.1" 200 None
2026-03-30 12:50:36 [auto1.fr] INFO: Scrape type for YS67726: 0
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 12:50:36 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 12:50:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:50:55 [auto1.fr] INFO: Channel: 24h | Page: 120 | totalHits: 5876 | hits on page: 40
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT49366%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for AT49366: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX11392%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for EX11392: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL72908%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for LL72908: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY61092%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for NY61092: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT90732%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for AT90732: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42425%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for MS42425: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK39621%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for AK39621: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB29476%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for FB29476: 0
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 12:50:55 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP92725%27 HTTP/1.1" 200 None
2026-03-30 12:50:55 [auto1.fr] INFO: Scrape type for VP92725: 0
2026-03-30 12:50:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:50:58 [scrapy.extensions.logstats] INFO: Crawled 324 pages (at 5 pages/min), scraped 215 items (at 2 items/min)
2026-03-30 12:50:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:51:58 [scrapy.extensions.logstats] INFO: Crawled 324 pages (at 0 pages/min), scraped 215 items (at 0 items/min)
2026-03-30 12:51:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:52:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:13 [auto1.fr] INFO: Channel: 24h | Page: 121 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP92725%27 HTTP/1.1" 200 None
2026-03-30 12:52:13 [auto1.fr] INFO: Scrape type for VP92725: 0
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT63906%27 HTTP/1.1" 200 None
2026-03-30 12:52:13 [auto1.fr] INFO: Scrape type for WT63906: 0
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC93057%27 HTTP/1.1" 200 None
2026-03-30 12:52:13 [auto1.fr] INFO: Scrape type for MC93057: 0
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV70954%27 HTTP/1.1" 200 None
2026-03-30 12:52:13 [auto1.fr] INFO: Scrape type for FV70954: 0
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 12:52:13 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 12:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX49968%27 HTTP/1.1" 200 None
2026-03-30 12:52:14 [auto1.fr] INFO: Scrape type for HX49968: 0
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 12:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY88704%27 HTTP/1.1" 200 None
2026-03-30 12:52:14 [auto1.fr] INFO: Scrape type for TY88704: 0
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 12:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY78807%27 HTTP/1.1" 200 None
2026-03-30 12:52:14 [auto1.fr] INFO: Scrape type for FY78807: 0
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 12:52:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:14 [auto1.fr] INFO: Channel: 24h | Page: 122 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 12:52:14 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM63788%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for MM63788: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR23602%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for DR23602: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT87839%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for XT87839: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA19421%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for WA19421: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT97510%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for RT97510: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU05090%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for JU05090: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE69678%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for GE69678: 2
2026-03-30 12:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e503c5e-70e3-5408-826d-4911eaa7745c with identifier: GE69678
2026-03-30 12:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e503c5e-70e3-5408-826d-4911eaa7745c with scrape type 2
2026-03-30 12:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e503c5e-70e3-5408-826d-4911eaa7745c with scrape type 2
2026-03-30 12:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e503c5e-70e3-5408-826d-4911eaa7745c, identifier: GE69678
2026-03-30 12:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e503c5e-70e3-5408-826d-4911eaa7745c with identifier: GE69678
2026-03-30 12:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e503c5e-70e3-5408-826d-4911eaa7745c with identifier: GE69678
2026-03-30 12:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e503c5e-70e3-5408-826d-4911eaa7745c with identifier: GE69678 to the API
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:31Z',
'fuel_type': 'diesel',
'id': '6e503c5e-70e3-5408-826d-4911eaa7745c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE69678',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 273467,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-31',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE69678%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Saving data for GE69678: {'auction_closing_time': 1774884751.0, 'created_time': 1773662400.676096, 'last_price_update_time': 1774875135.604088}
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE69678') HTTP/1.1" 204 0
2026-03-30 12:52:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR57838%27 HTTP/1.1" 200 None
2026-03-30 12:52:15 [auto1.fr] INFO: Scrape type for UR57838: 0
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 12:52:15 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 12:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:24 [auto1.fr] INFO: Channel: 24h | Page: 123 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP94491%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for KP94491: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM17669%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for BM17669: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA54656%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for YA54656: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL60672%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for RL60672: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM29427%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for GM29427: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY87509%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for TY87509: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS73075%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for GS73075: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL76825%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for FL76825: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE10155%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for JE10155: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF06109%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for SF06109: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF07338%27 HTTP/1.1" 200 None
2026-03-30 12:52:24 [auto1.fr] INFO: Scrape type for JF07338: 0
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 12:52:24 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 12:52:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:52:33 [auto1.fr] INFO: Channel: 24h | Page: 124 | totalHits: 5885 | hits on page: 40
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF56571%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for BF56571: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ13583%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for WJ13583: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK21473%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for CK21473: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC86426%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for AC86426: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG27801%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for HG27801: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN02557%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for ZN02557: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN42354%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for EN42354: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM20172%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for RM20172: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE83883%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for EE83883: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS48981%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for HS48981: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF53707%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for WF53707: 0
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 12:52:33 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV92189%27 HTTP/1.1" 200 None
2026-03-30 12:52:33 [auto1.fr] INFO: Scrape type for AV92189: 0
2026-03-30 12:52:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:52:58 [scrapy.extensions.logstats] INFO: Crawled 328 pages (at 4 pages/min), scraped 216 items (at 1 items/min)
2026-03-30 12:52:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:53:38 [auto1.fr] INFO: Channel: 24h | Page: 125 | totalHits: 5891 | hits on page: 40
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS48981%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for HS48981: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF53707%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for WF53707: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV92189%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for AV92189: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK04898%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for PK04898: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB80018%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for XB80018: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC36334%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for YC36334: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC19073%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for GC19073: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG10536%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for TG10536: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW68314%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for KW68314: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU24088%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for MU24088: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF25900%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for HF25900: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD81784%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for WD81784: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ79927%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for PZ79927: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:53:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG32180%27 HTTP/1.1" 200 None
2026-03-30 12:53:38 [auto1.fr] INFO: Scrape type for JG32180: 0
2026-03-30 12:53:38 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 12:53:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:53:58 [scrapy.extensions.logstats] INFO: Crawled 329 pages (at 1 pages/min), scraped 216 items (at 0 items/min)
2026-03-30 12:53:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:54:48 [auto1.fr] INFO: Channel: 24h | Page: 126 | totalHits: 5895 | hits on page: 40
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG32180%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for JG32180: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB54274%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for VB54274: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG24265%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for KG24265: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF90019%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for TF90019: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX69066%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for FX69066: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ55731%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for CJ55731: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC34871%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for MC34871: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR54238%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for TR54238: 0
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 12:54:48 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK60890%27 HTTP/1.1" 200 None
2026-03-30 12:54:48 [auto1.fr] INFO: Scrape type for ZK60890: 0
2026-03-30 12:54:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:54:58 [scrapy.extensions.logstats] INFO: Crawled 330 pages (at 1 pages/min), scraped 216 items (at 0 items/min)
2026-03-30 12:54:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:55:58 [auto1.fr] INFO: Channel: 24h | Page: 127 | totalHits: 5899 | hits on page: 40
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR54238%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for TR54238: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK60890%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for ZK60890: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR72983%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for MR72983: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC15734%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for DC15734: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE35297%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for CE35297: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP19975%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for ZP19975: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD77771%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for MD77771: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP36468%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for NP36468: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:55:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL84950%27 HTTP/1.1" 200 None
2026-03-30 12:55:58 [auto1.fr] INFO: Scrape type for SL84950: 0
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 12:55:58 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 12:55:58 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 1 pages/min), scraped 216 items (at 0 items/min)
2026-03-30 12:55:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:55:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:56:58 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 0 pages/min), scraped 216 items (at 0 items/min)
2026-03-30 12:56:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:57:58 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 0 pages/min), scraped 216 items (at 0 items/min)
2026-03-30 12:57:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:58:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.867(s), this was the 1st time calling it.
2026-03-30 12:58:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.54627603943135 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:58:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:58:25 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:25 [auto1.fr] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3723.4s). Queued for retry (1 pending).
2026-03-30 12:58:25 [auto1.fr] INFO: Initiating token refresh...
2026-03-30 12:58:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:26 [auto1.fr] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 12:58:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:28 [auto1.fr] INFO: Channel: 24h | Page: 128 | totalHits: 5914 | hits on page: 40
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD77771%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for MD77771: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP36468%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for NP36468: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL84950%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for SL84950: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD54427%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for WD54427: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL62948%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for CL62948: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG67985%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for SG67985: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF65661%27 HTTP/1.1" 200 None
2026-03-30 12:58:28 [auto1.fr] INFO: Scrape type for UF65661: 0
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 12:58:28 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 12:58:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:29 [auto1.fr] INFO: Channel: 24h | Page: 129 | totalHits: 5914 | hits on page: 40
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK63767%27 HTTP/1.1" 200 None
2026-03-30 12:58:29 [auto1.fr] INFO: Scrape type for HK63767: 0
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE45275%27 HTTP/1.1" 200 None
2026-03-30 12:58:29 [auto1.fr] INFO: Scrape type for FE45275: 0
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ70757%27 HTTP/1.1" 200 None
2026-03-30 12:58:29 [auto1.fr] INFO: Scrape type for AJ70757: 0
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD75510%27 HTTP/1.1" 200 None
2026-03-30 12:58:29 [auto1.fr] INFO: Scrape type for DD75510: 0
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF23948%27 HTTP/1.1" 200 None
2026-03-30 12:58:29 [auto1.fr] INFO: Scrape type for ZF23948: 0
2026-03-30 12:58:29 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 12:58:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM84463%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for WM84463: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU34915%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for TU34915: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS44822%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for XS44822: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN50971%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for MN50971: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP79146%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for MP79146: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD28523%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for GD28523: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ71814%27 HTTP/1.1" 200 None
2026-03-30 12:58:30 [auto1.fr] INFO: Scrape type for FJ71814: 0
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 12:58:30 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 12:58:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:38 [auto1.fr] INFO: Channel: 24h | Page: 130 | totalHits: 5914 | hits on page: 40
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY36168%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for BY36168: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL52555%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for WL52555: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ61666%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for JJ61666: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ87165%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for JJ87165: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF09480%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for PF09480: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG34511%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for MG34511: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL47333%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for VL47333: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR22803%27 HTTP/1.1" 200 None
2026-03-30 12:58:38 [auto1.fr] INFO: Scrape type for KR22803: 0
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 12:58:38 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 12:58:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:39 [auto1.fr] INFO: Channel: 24h | Page: 131 | totalHits: 5915 | hits on page: 40
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU22496%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for NU22496: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD96276%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for PD96276: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP39204%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for DP39204: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE12141%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for NE12141: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL34830%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for UL34830: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM21861%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for UM21861: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF97734%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for LF97734: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS84177%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for RS84177: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW48684%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for BW48684: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW23065%27 HTTP/1.1" 200 None
2026-03-30 12:58:39 [auto1.fr] INFO: Scrape type for MW23065: 0
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 12:58:39 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 12:58:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:40 [auto1.fr] INFO: Channel: 24h | Page: 132 | totalHits: 5916 | hits on page: 40
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 12:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM45257%27 HTTP/1.1" 200 None
2026-03-30 12:58:40 [auto1.fr] INFO: Scrape type for SM45257: 0
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 12:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF66923%27 HTTP/1.1" 200 None
2026-03-30 12:58:40 [auto1.fr] INFO: Scrape type for ZF66923: 0
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 12:58:40 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE67230%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for UE67230: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ10392%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for EJ10392: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW66218%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for TW66218: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA91720%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for NA91720: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY55554%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for DY55554: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV47129%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for SV47129: 0
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 12:58:41 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC09980%27 HTTP/1.1" 200 None
2026-03-30 12:58:41 [auto1.fr] INFO: Scrape type for RC09980: 0
2026-03-30 12:58:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:46 [auto1.fr] INFO: Channel: 24h | Page: 133 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC09980%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for RC09980: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES67441%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for ES67441: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ90327%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for AJ90327: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK28598%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for BK28598: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP28351%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for YP28351: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW75406%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for UW75406: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM68465%27 HTTP/1.1" 200 None
2026-03-30 12:58:46 [auto1.fr] INFO: Scrape type for ZM68465: 0
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 12:58:46 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 12:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH87358%27 HTTP/1.1" 200 None
2026-03-30 12:58:47 [auto1.fr] INFO: Scrape type for LH87358: 0
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 12:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG93466%27 HTTP/1.1" 200 None
2026-03-30 12:58:47 [auto1.fr] INFO: Scrape type for RG93466: 0
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 12:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM40591%27 HTTP/1.1" 200 None
2026-03-30 12:58:47 [auto1.fr] INFO: Scrape type for MM40591: 0
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 12:58:47 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 12:58:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:48 [auto1.fr] INFO: Channel: 24h | Page: 134 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY74079%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for CY74079: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU26111%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for KU26111: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR42379%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for RR42379: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA90047%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for SA90047: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN11414%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for LN11414: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB12205%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for NB12205: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG76563%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for HG76563: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS98068%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for BS98068: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR64418%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for YR64418: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG64502%27 HTTP/1.1" 200 None
2026-03-30 12:58:48 [auto1.fr] INFO: Scrape type for CG64502: 0
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 12:58:48 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 12:58:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:49 [auto1.fr] INFO: Channel: 24h | Page: 135 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP52788%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for VP52788: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR51870%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for DR51870: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM10351%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for AM10351: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL29866%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for VL29866: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK56384%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for JK56384: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW95996%27 HTTP/1.1" 200 None
2026-03-30 12:58:49 [auto1.fr] INFO: Scrape type for WW95996: 0
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 12:58:49 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA63430%27 HTTP/1.1" 200 None
2026-03-30 12:58:50 [auto1.fr] INFO: Scrape type for DA63430: 0
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN93768%27 HTTP/1.1" 200 None
2026-03-30 12:58:50 [auto1.fr] INFO: Scrape type for HN93768: 0
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP76636%27 HTTP/1.1" 200 None
2026-03-30 12:58:50 [auto1.fr] INFO: Scrape type for GP76636: 0
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW34434%27 HTTP/1.1" 200 None
2026-03-30 12:58:50 [auto1.fr] INFO: Scrape type for GW34434: 0
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29757%27 HTTP/1.1" 200 None
2026-03-30 12:58:50 [auto1.fr] INFO: Scrape type for ZE29757: 0
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 12:58:50 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 12:58:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:52 [auto1.fr] INFO: Channel: 24h | Page: 136 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP83424%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for TP83424: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH79850%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for MH79850: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV23431%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for VV23431: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL18165%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for EL18165: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA56665%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for JA56665: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG23790%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for LG23790: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC34006%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for KC34006: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM07810%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for BM07810: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB52956%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for AB52956: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR06479%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for PR06479: 0
2026-03-30 12:58:52 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF87574%27 HTTP/1.1" 200 None
2026-03-30 12:58:52 [auto1.fr] INFO: Scrape type for KF87574: 0
2026-03-30 12:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:54 [auto1.fr] INFO: Channel: 24h | Page: 137 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT87485%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for MT87485: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY57315%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for NY57315: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP98531%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for YP98531: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN87071%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for HN87071: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB59125%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for ZB59125: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP44396%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for LP44396: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK60696%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for LK60696: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS54085%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for RS54085: 0
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 12:58:54 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK67799%27 HTTP/1.1" 200 None
2026-03-30 12:58:54 [auto1.fr] INFO: Scrape type for SK67799: 2
2026-03-30 12:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33ac3222-671c-5c3f-bd63-b34024797c90 with identifier: SK67799
2026-03-30 12:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33ac3222-671c-5c3f-bd63-b34024797c90 with scrape type 2
2026-03-30 12:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33ac3222-671c-5c3f-bd63-b34024797c90 with scrape type 2
2026-03-30 12:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 33ac3222-671c-5c3f-bd63-b34024797c90, identifier: SK67799
2026-03-30 12:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 33ac3222-671c-5c3f-bd63-b34024797c90 with identifier: SK67799
2026-03-30 12:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 33ac3222-671c-5c3f-bd63-b34024797c90 with identifier: SK67799
2026-03-30 12:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 33ac3222-671c-5c3f-bd63-b34024797c90 with identifier: SK67799 to the API
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:27:45Z',
'fuel_type': 'diesel',
'id': '33ac3222-671c-5c3f-bd63-b34024797c90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK67799',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Bipper',
'odometer': 191300,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-27',
'seller_name': None,
'title': 'Peugeot Bipper 1.4 HDi Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2008}
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK67799%27 HTTP/1.1" 200 None
2026-03-30 12:58:55 [auto1.fr] INFO: Saving data for SK67799: {'auction_closing_time': 1774884465.0, 'created_time': 1774696501.789317, 'last_price_update_time': 1774875535.473136}
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SK67799') HTTP/1.1" 204 0
2026-03-30 12:58:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 12:58:55 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP74967%27 HTTP/1.1" 200 None
2026-03-30 12:58:55 [auto1.fr] INFO: Scrape type for BP74967: 2
2026-03-30 12:58:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25be7466-87dc-5201-9c9d-62c254c8ba09 with identifier: BP74967
2026-03-30 12:58:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25be7466-87dc-5201-9c9d-62c254c8ba09 with scrape type 2
2026-03-30 12:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25be7466-87dc-5201-9c9d-62c254c8ba09 with scrape type 2
2026-03-30 12:58:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25be7466-87dc-5201-9c9d-62c254c8ba09, identifier: BP74967
2026-03-30 12:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25be7466-87dc-5201-9c9d-62c254c8ba09 with identifier: BP74967
2026-03-30 12:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25be7466-87dc-5201-9c9d-62c254c8ba09 with identifier: BP74967
2026-03-30 12:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25be7466-87dc-5201-9c9d-62c254c8ba09 with identifier: BP74967 to the API
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:58:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:12:59Z',
'fuel_type': 'petrol',
'id': '25be7466-87dc-5201-9c9d-62c254c8ba09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP74967',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 49876,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-25',
'seller_name': None,
'title': 'Peugeot Partner 1.2 PureTech Pro L1',
'transmission': 'manual',
'trim': 'Pro L1',
'year': 2020}
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP74967%27 HTTP/1.1" 200 None
2026-03-30 12:58:56 [auto1.fr] INFO: Saving data for BP74967: {'auction_closing_time': 1774883579.0, 'created_time': 1773432906.877211, 'last_price_update_time': 1774875536.046503}
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP74967') HTTP/1.1" 204 0
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA88179%27 HTTP/1.1" 200 None
2026-03-30 12:58:56 [auto1.fr] INFO: Scrape type for VA88179: 0
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 12:58:56 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 12:58:58 [scrapy.extensions.logstats] INFO: Crawled 343 pages (at 12 pages/min), scraped 218 items (at 2 items/min)
2026-03-30 12:58:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 12:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:58:59 [auto1.fr] INFO: Channel: 24h | Page: 138 | totalHits: 5918 | hits on page: 40
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 12:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM18716%27 HTTP/1.1" 200 None
2026-03-30 12:58:59 [auto1.fr] INFO: Scrape type for BM18716: 0
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 12:58:59 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 12:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC88439%27 HTTP/1.1" 200 None
2026-03-30 12:58:59 [auto1.fr] INFO: Scrape type for VC88439: 2
2026-03-30 12:58:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with identifier: VC88439
2026-03-30 12:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with scrape type 2
2026-03-30 12:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with scrape type 2
2026-03-30 12:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1375148a-3b2f-5634-8bf6-0f51bb4d9117, identifier: VC88439
2026-03-30 12:58:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with identifier: VC88439
2026-03-30 12:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with identifier: VC88439
2026-03-30 12:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1375148a-3b2f-5634-8bf6-0f51bb4d9117 with identifier: VC88439 to the API
2026-03-30 12:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:33Z',
'fuel_type': 'petrol',
'id': '1375148a-3b2f-5634-8bf6-0f51bb4d9117',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC88439',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 111533,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-24',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC88439%27 HTTP/1.1" 200 None
2026-03-30 12:59:00 [auto1.fr] INFO: Saving data for VC88439: {'auction_closing_time': 1774882833.0, 'created_time': 1774696504.777037, 'last_price_update_time': 1774875540.156758}
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VC88439') HTTP/1.1" 204 0
2026-03-30 12:59:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC51722%27 HTTP/1.1" 200 None
2026-03-30 12:59:00 [auto1.fr] INFO: Scrape type for EC51722: 2
2026-03-30 12:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcc6beea-6f96-5993-b608-f689fb93544f with identifier: EC51722
2026-03-30 12:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcc6beea-6f96-5993-b608-f689fb93544f with scrape type 2
2026-03-30 12:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcc6beea-6f96-5993-b608-f689fb93544f with scrape type 2
2026-03-30 12:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcc6beea-6f96-5993-b608-f689fb93544f, identifier: EC51722
2026-03-30 12:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcc6beea-6f96-5993-b608-f689fb93544f with identifier: EC51722
2026-03-30 12:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcc6beea-6f96-5993-b608-f689fb93544f with identifier: EC51722
2026-03-30 12:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dcc6beea-6f96-5993-b608-f689fb93544f with identifier: EC51722 to the API
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-30T15:10:11Z',
'fuel_type': 'diesel',
'id': 'dcc6beea-6f96-5993-b608-f689fb93544f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC51722',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 127466,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-06',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2011}
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC51722%27 HTTP/1.1" 200 None
2026-03-30 12:59:00 [auto1.fr] INFO: Saving data for EC51722: {'auction_closing_time': 1774883411.0, 'created_time': 1772105153.318769, 'last_price_update_time': 1774875540.672956}
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EC51722') HTTP/1.1" 204 0
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 12:59:00 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ22819%27 HTTP/1.1" 200 None
2026-03-30 12:59:00 [auto1.fr] INFO: Scrape type for BJ22819: 2
2026-03-30 12:59:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13bc0c16-dc81-5058-8596-1c211eb006e9 with identifier: BJ22819
2026-03-30 12:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13bc0c16-dc81-5058-8596-1c211eb006e9 with scrape type 2
2026-03-30 12:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13bc0c16-dc81-5058-8596-1c211eb006e9 with scrape type 2
2026-03-30 12:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13bc0c16-dc81-5058-8596-1c211eb006e9, identifier: BJ22819
2026-03-30 12:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13bc0c16-dc81-5058-8596-1c211eb006e9 with identifier: BJ22819
2026-03-30 12:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13bc0c16-dc81-5058-8596-1c211eb006e9 with identifier: BJ22819
2026-03-30 12:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13bc0c16-dc81-5058-8596-1c211eb006e9 with identifier: BJ22819 to the API
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:29:42Z',
'fuel_type': 'petrol',
'id': '13bc0c16-dc81-5058-8596-1c211eb006e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ22819',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 107335,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-18',
'seller_name': None,
'title': 'Fiat 500 0.9 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ22819%27 HTTP/1.1" 200 None
2026-03-30 12:59:01 [auto1.fr] INFO: Saving data for BJ22819: {'auction_closing_time': 1774884582.0, 'created_time': 1772736154.590738, 'last_price_update_time': 1774875541.172052}
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ22819') HTTP/1.1" 204 0
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE34830%27 HTTP/1.1" 200 None
2026-03-30 12:59:01 [auto1.fr] INFO: Scrape type for TE34830: 2
2026-03-30 12:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with identifier: TE34830
2026-03-30 12:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with scrape type 2
2026-03-30 12:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with scrape type 2
2026-03-30 12:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a, identifier: TE34830
2026-03-30 12:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with identifier: TE34830
2026-03-30 12:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with identifier: TE34830
2026-03-30 12:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a with identifier: TE34830 to the API
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:07:23Z',
'fuel_type': 'petrol',
'id': '76b2fec7-18e8-5e53-bfd4-6a27a73a1c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE34830',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 17779,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2020}
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE34830%27 HTTP/1.1" 200 None
2026-03-30 12:59:01 [auto1.fr] INFO: Saving data for TE34830: {'auction_closing_time': 1774883243.0, 'created_time': 1774091489.295556, 'last_price_update_time': 1774875541.598077}
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE34830') HTTP/1.1" 204 0
2026-03-30 12:59:01 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH56939%27 HTTP/1.1" 200 None
2026-03-30 12:59:01 [auto1.fr] INFO: Scrape type for NH56939: 2
2026-03-30 12:59:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with identifier: NH56939
2026-03-30 12:59:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with scrape type 2
2026-03-30 12:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with scrape type 2
2026-03-30 12:59:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6491b1ee-8c1e-5ffa-bce0-2fde096009d6, identifier: NH56939
2026-03-30 12:59:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with identifier: NH56939
2026-03-30 12:59:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with identifier: NH56939
2026-03-30 12:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6491b1ee-8c1e-5ffa-bce0-2fde096009d6 with identifier: NH56939 to the API
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:49:02Z',
'fuel_type': 'petrol',
'id': '6491b1ee-8c1e-5ffa-bce0-2fde096009d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH56939',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 135585,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 12:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH56939%27 HTTP/1.1" 200 None
2026-03-30 12:59:02 [auto1.fr] INFO: Saving data for NH56939: {'auction_closing_time': 1774885742.0, 'created_time': 1773410952.133721, 'last_price_update_time': 1774875542.088027}
2026-03-30 12:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH56939') HTTP/1.1" 204 0
2026-03-30 12:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:59:03 [auto1.fr] INFO: Channel: 24h | Page: 139 | totalHits: 5918 | hits on page: 40
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY77221%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for VY77221: 2
2026-03-30 12:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with identifier: VY77221
2026-03-30 12:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with scrape type 2
2026-03-30 12:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with scrape type 2
2026-03-30 12:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca, identifier: VY77221
2026-03-30 12:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with identifier: VY77221
2026-03-30 12:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with identifier: VY77221
2026-03-30 12:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca with identifier: VY77221 to the API
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'diesel',
'id': 'ca3bbbf1-3eb8-5f69-88ae-7c09bb1c0fca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY77221',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 238950,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-31',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Napapijri',
'transmission': 'manual',
'trim': 'Napapijri',
'year': 2013}
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY77221%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Saving data for VY77221: {'auction_closing_time': 1774883426.0, 'created_time': 1774091571.557059, 'last_price_update_time': 1774875543.415529}
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY77221') HTTP/1.1" 204 0
2026-03-30 12:59:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH19113%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for JH19113: 0
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN45042%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for KN45042: 0
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX46107%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for LX46107: 0
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA97612%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for EA97612: 0
2026-03-30 12:59:03 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB58313%27 HTTP/1.1" 200 None
2026-03-30 12:59:03 [auto1.fr] INFO: Scrape type for JB58313: 2
2026-03-30 12:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89587d40-584d-5b83-b6e5-77687350fc9a with identifier: JB58313
2026-03-30 12:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89587d40-584d-5b83-b6e5-77687350fc9a with scrape type 2
2026-03-30 12:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89587d40-584d-5b83-b6e5-77687350fc9a with scrape type 2
2026-03-30 12:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89587d40-584d-5b83-b6e5-77687350fc9a, identifier: JB58313
2026-03-30 12:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89587d40-584d-5b83-b6e5-77687350fc9a with identifier: JB58313
2026-03-30 12:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89587d40-584d-5b83-b6e5-77687350fc9a with identifier: JB58313
2026-03-30 12:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89587d40-584d-5b83-b6e5-77687350fc9a with identifier: JB58313 to the API
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'petrol',
'id': '89587d40-584d-5b83-b6e5-77687350fc9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB58313',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 38080,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-02',
'seller_name': None,
'title': 'Citroen C3 1.2 e-THP Feel 3',
'transmission': 'manual',
'trim': 'Feel 3',
'year': 2017}
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB58313%27 HTTP/1.1" 200 None
2026-03-30 12:59:04 [auto1.fr] INFO: Saving data for JB58313: {'auction_closing_time': 1774883146.0, 'created_time': 1774696539.839075, 'last_price_update_time': 1774875544.033497}
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB58313') HTTP/1.1" 204 0
2026-03-30 12:59:04 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL20773%27 HTTP/1.1" 200 None
2026-03-30 12:59:04 [auto1.fr] INFO: Scrape type for DL20773: 0
2026-03-30 12:59:04 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 12:59:04 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 12:59:04 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 12:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:59:05 [auto1.fr] INFO: Channel: 24h | Page: 140 | totalHits: 5918 | hits on page: 40
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK88596%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for SK88596: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ89285%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for KZ89285: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY90966%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for GY90966: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC54158%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for YC54158: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY58492%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for CY58492: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE19046%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for CE19046: 0
2026-03-30 12:59:05 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW04055%27 HTTP/1.1" 200 None
2026-03-30 12:59:05 [auto1.fr] INFO: Scrape type for UW04055: 2
2026-03-30 12:59:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with identifier: UW04055
2026-03-30 12:59:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with scrape type 2
2026-03-30 12:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with scrape type 2
2026-03-30 12:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12fb4711-954c-5b71-ba3c-2d5a464e29f7, identifier: UW04055
2026-03-30 12:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with identifier: UW04055
2026-03-30 12:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with identifier: UW04055
2026-03-30 12:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12fb4711-954c-5b71-ba3c-2d5a464e29f7 with identifier: UW04055 to the API
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 86,
'expiration_date': '2026-03-30T15:14:34Z',
'fuel_type': 'petrol',
'id': '12fb4711-954c-5b71-ba3c-2d5a464e29f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW04055',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 128696,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seller_name': None,
'title': 'Ford Fiesta 1.1 Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2018}
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW04055%27 HTTP/1.1" 200 None
2026-03-30 12:59:06 [auto1.fr] INFO: Saving data for UW04055: {'auction_closing_time': 1774883674.0, 'created_time': 1773328932.327902, 'last_price_update_time': 1774875546.372615}
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UW04055') HTTP/1.1" 204 0
2026-03-30 12:59:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW44211%27 HTTP/1.1" 200 None
2026-03-30 12:59:06 [auto1.fr] INFO: Scrape type for BW44211: 0
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW18570%27 HTTP/1.1" 200 None
2026-03-30 12:59:06 [auto1.fr] INFO: Scrape type for FW18570: 0
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 12:59:06 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV07221%27 HTTP/1.1" 200 None
2026-03-30 12:59:06 [auto1.fr] INFO: Scrape type for DV07221: 2
2026-03-30 12:59:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bc9cc0-5fb2-5ce9-af36-985f336c437c with identifier: DV07221
2026-03-30 12:59:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bc9cc0-5fb2-5ce9-af36-985f336c437c with scrape type 2
2026-03-30 12:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bc9cc0-5fb2-5ce9-af36-985f336c437c with scrape type 2
2026-03-30 12:59:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26bc9cc0-5fb2-5ce9-af36-985f336c437c, identifier: DV07221
2026-03-30 12:59:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26bc9cc0-5fb2-5ce9-af36-985f336c437c with identifier: DV07221
2026-03-30 12:59:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26bc9cc0-5fb2-5ce9-af36-985f336c437c with identifier: DV07221
2026-03-30 12:59:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26bc9cc0-5fb2-5ce9-af36-985f336c437c with identifier: DV07221 to the API
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:34Z',
'fuel_type': 'petrol',
'id': '26bc9cc0-5fb2-5ce9-af36-985f336c437c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV07221',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 71319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-29',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV07221%27 HTTP/1.1" 200 None
2026-03-30 12:59:06 [auto1.fr] INFO: Saving data for DV07221: {'auction_closing_time': 1774885534.0, 'created_time': 1774091442.055566, 'last_price_update_time': 1774875546.896643}
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DV07221') HTTP/1.1" 204 0
2026-03-30 12:59:07 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB17264%27 HTTP/1.1" 200 None
2026-03-30 12:59:07 [auto1.fr] INFO: Scrape type for GB17264: 2
2026-03-30 12:59:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6663768f-a808-548c-8d97-52d9f3e4b58f with identifier: GB17264
2026-03-30 12:59:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6663768f-a808-548c-8d97-52d9f3e4b58f with scrape type 2
2026-03-30 12:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6663768f-a808-548c-8d97-52d9f3e4b58f with scrape type 2
2026-03-30 12:59:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6663768f-a808-548c-8d97-52d9f3e4b58f, identifier: GB17264
2026-03-30 12:59:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6663768f-a808-548c-8d97-52d9f3e4b58f with identifier: GB17264
2026-03-30 12:59:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6663768f-a808-548c-8d97-52d9f3e4b58f with identifier: GB17264
2026-03-30 12:59:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6663768f-a808-548c-8d97-52d9f3e4b58f with identifier: GB17264 to the API
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:08:55Z',
'fuel_type': 'petrol',
'id': '6663768f-a808-548c-8d97-52d9f3e4b58f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB17264',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 37106,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-31',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo GS Line',
'transmission': 'manual',
'trim': 'GS Line',
'year': 2020}
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB17264%27 HTTP/1.1" 200 None
2026-03-30 12:59:07 [auto1.fr] INFO: Saving data for GB17264: {'auction_closing_time': 1774883335.0, 'created_time': 1774005112.190532, 'last_price_update_time': 1774875547.399038}
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GB17264') HTTP/1.1" 204 0
2026-03-30 12:59:07 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 12:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:59:38 [auto1.fr] INFO: Channel: 24h | Page: 141 | totalHits: 5921 | hits on page: 40
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV07221%27 HTTP/1.1" 200 None
2026-03-30 12:59:38 [auto1.fr] INFO: Scrape type for DV07221: 0
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB17264%27 HTTP/1.1" 200 None
2026-03-30 12:59:38 [auto1.fr] INFO: Scrape type for GB17264: 0
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 12:59:38 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU41206%27 HTTP/1.1" 200 None
2026-03-30 12:59:38 [auto1.fr] INFO: Scrape type for ZU41206: 2
2026-03-30 12:59:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with identifier: ZU41206
2026-03-30 12:59:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with scrape type 2
2026-03-30 12:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with scrape type 2
2026-03-30 12:59:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c0bdf06-e17b-57c4-a2ad-d000616cb73c, identifier: ZU41206
2026-03-30 12:59:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with identifier: ZU41206
2026-03-30 12:59:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with identifier: ZU41206
2026-03-30 12:59:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c0bdf06-e17b-57c4-a2ad-d000616cb73c with identifier: ZU41206 to the API
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:27Z',
'fuel_type': 'petrol',
'id': '1c0bdf06-e17b-57c4-a2ad-d000616cb73c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU41206',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 175489,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-25',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI ACT S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2017}
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU41206%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Saving data for ZU41206: {'auction_closing_time': 1774885827.0, 'created_time': 1774106070.778612, 'last_price_update_time': 1774875579.044207}
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZU41206') HTTP/1.1" 204 0
2026-03-30 12:59:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW64716%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Scrape type for FW64716: 2
2026-03-30 12:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with identifier: FW64716
2026-03-30 12:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with scrape type 2
2026-03-30 12:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with scrape type 2
2026-03-30 12:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb, identifier: FW64716
2026-03-30 12:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with identifier: FW64716
2026-03-30 12:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with identifier: FW64716
2026-03-30 12:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb with identifier: FW64716 to the API
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:48:14Z',
'fuel_type': 'petrol',
'id': 'da51a2f4-8ae8-56a9-ae22-c4ae4f28aadb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW64716',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 106063,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW64716%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Saving data for FW64716: {'auction_closing_time': 1774885694.0, 'created_time': 1774105914.995162, 'last_price_update_time': 1774875579.517604}
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW64716') HTTP/1.1" 204 0
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB74515%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Scrape type for MB74515: 0
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS87605%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Scrape type for KS87605: 0
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK79234%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Scrape type for UK79234: 0
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 12:59:39 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV79615%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Scrape type for JV79615: 2
2026-03-30 12:59:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8fe8e21-afb6-5e49-8251-b7502c3bde41 with identifier: JV79615
2026-03-30 12:59:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8fe8e21-afb6-5e49-8251-b7502c3bde41 with scrape type 2
2026-03-30 12:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8fe8e21-afb6-5e49-8251-b7502c3bde41 with scrape type 2
2026-03-30 12:59:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8fe8e21-afb6-5e49-8251-b7502c3bde41, identifier: JV79615
2026-03-30 12:59:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8fe8e21-afb6-5e49-8251-b7502c3bde41 with identifier: JV79615
2026-03-30 12:59:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8fe8e21-afb6-5e49-8251-b7502c3bde41 with identifier: JV79615
2026-03-30 12:59:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8fe8e21-afb6-5e49-8251-b7502c3bde41 with identifier: JV79615 to the API
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:01:59Z',
'fuel_type': 'petrol',
'id': 'b8fe8e21-afb6-5e49-8251-b7502c3bde41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV79615',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 63508,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV79615%27 HTTP/1.1" 200 None
2026-03-30 12:59:39 [auto1.fr] INFO: Saving data for JV79615: {'auction_closing_time': 1774882919.0, 'created_time': 1773994462.104145, 'last_price_update_time': 1774875579.9722}
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JV79615') HTTP/1.1" 204 0
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB65307%27 HTTP/1.1" 200 None
2026-03-30 12:59:40 [auto1.fr] INFO: Scrape type for AB65307: 2
2026-03-30 12:59:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7331bc-3c0b-5048-8349-2d2f196623e9 with identifier: AB65307
2026-03-30 12:59:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7331bc-3c0b-5048-8349-2d2f196623e9 with scrape type 2
2026-03-30 12:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7331bc-3c0b-5048-8349-2d2f196623e9 with scrape type 2
2026-03-30 12:59:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb7331bc-3c0b-5048-8349-2d2f196623e9, identifier: AB65307
2026-03-30 12:59:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb7331bc-3c0b-5048-8349-2d2f196623e9 with identifier: AB65307
2026-03-30 12:59:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb7331bc-3c0b-5048-8349-2d2f196623e9 with identifier: AB65307
2026-03-30 12:59:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb7331bc-3c0b-5048-8349-2d2f196623e9 with identifier: AB65307 to the API
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:02:56Z',
'fuel_type': 'diesel',
'id': 'bb7331bc-3c0b-5048-8349-2d2f196623e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB65307',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 266882,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB65307%27 HTTP/1.1" 200 None
2026-03-30 12:59:40 [auto1.fr] INFO: Saving data for AB65307: {'auction_closing_time': 1774882976.0, 'created_time': 1773936867.472282, 'last_price_update_time': 1774875580.525469}
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB65307') HTTP/1.1" 204 0
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT80475%27 HTTP/1.1" 200 None
2026-03-30 12:59:40 [auto1.fr] INFO: Scrape type for ZT80475: 0
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 12:59:40 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 12:59:58 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 4 pages/min), scraped 232 items (at 14 items/min)
2026-03-30 12:59:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:00:58 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 0 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:00:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:01:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.818(s), this was the 1st time calling it.
2026-03-30 13:01:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.911359562009306 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 13:01:58 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 0 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:01:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:02:58 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 0 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:02:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:03:58 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 0 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:03:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:04:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 269.034(s), this was the 2nd time calling it.
2026-03-30 13:04:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.77790241614853 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 13:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 13:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:04:49 [auto1.fr] INFO: Channel: 24h | Page: 142 | totalHits: 5946 | hits on page: 40
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS87605%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for KS87605: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK79234%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for UK79234: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV79615%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for JV79615: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB65307%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for AB65307: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT80475%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for ZT80475: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR90529%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for MR90529: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV82295%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for TV82295: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU27709%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for LU27709: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW71703%27 HTTP/1.1" 200 None
2026-03-30 13:04:49 [auto1.fr] INFO: Scrape type for VW71703: 0
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 13:04:49 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 13:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:04:58 [scrapy.extensions.logstats] INFO: Crawled 348 pages (at 1 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:04:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:05:56 [auto1.fr] INFO: Channel: 24h | Page: 143 | totalHits: 5949 | hits on page: 40
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM74121%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for FM74121: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC98721%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for FC98721: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ59181%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for FZ59181: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC64780%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for UC64780: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS04857%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for XS04857: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD56063%27 HTTP/1.1" 200 None
2026-03-30 13:05:56 [auto1.fr] INFO: Scrape type for BD56063: 0
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 13:05:56 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 13:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:05:58 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 1 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:05:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:05:59 [auto1.fr] INFO: Channel: 24h | Page: 144 | totalHits: 5950 | hits on page: 40
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC76298%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for VC76298: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV08721%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for FV08721: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL41639%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for ZL41639: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH30868%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for VH30868: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG44189%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for BG44189: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB97802%27 HTTP/1.1" 200 None
2026-03-30 13:05:59 [auto1.fr] INFO: Scrape type for SB97802: 0
2026-03-30 13:05:59 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 13:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:06:19 [auto1.fr] INFO: Channel: 24h | Page: 145 | totalHits: 5953 | hits on page: 40
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG44189%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for BG44189: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB97802%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for SB97802: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY46453%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for VY46453: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB93525%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for DB93525: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY82545%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for UY82545: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD87549%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for RD87549: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN15329%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for GN15329: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC86596%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for XC86596: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN27034%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for XN27034: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW89890%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for FW89890: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR83482%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for HR83482: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE72026%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for XE72026: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF26639%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for GF26639: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG94762%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for MG94762: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ07481%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for RJ07481: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE16671%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for CE16671: 0
2026-03-30 13:06:19 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX88375%27 HTTP/1.1" 200 None
2026-03-30 13:06:19 [auto1.fr] INFO: Scrape type for LX88375: 0
2026-03-30 13:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:06:40 [auto1.fr] INFO: Channel: 24h | Page: 146 | totalHits: 5954 | hits on page: 40
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX88375%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for LX88375: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB78862%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for ZB78862: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF56983%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for CF56983: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP42968%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for GP42968: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH48548%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for NH48548: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA55290%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for PA55290: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY94549%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for LY94549: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA98443%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for LA98443: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU00546%27 HTTP/1.1" 200 None
2026-03-30 13:06:40 [auto1.fr] INFO: Scrape type for MU00546: 0
2026-03-30 13:06:40 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 13:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:06:57 [auto1.fr] INFO: Channel: 24h | Page: 147 | totalHits: 5956 | hits on page: 40
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU00546%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for MU00546: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV19654%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for SV19654: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH96092%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for MH96092: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS55707%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for LS55707: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL44219%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for PL44219: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS69033%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for LS69033: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY88788%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for BY88788: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF85983%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for RF85983: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS85106%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for VS85106: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN79186%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for AN79186: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV86348%27 HTTP/1.1" 200 None
2026-03-30 13:06:57 [auto1.fr] INFO: Scrape type for RV86348: 0
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 13:06:57 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 13:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:06:58 [scrapy.extensions.logstats] INFO: Crawled 354 pages (at 5 pages/min), scraped 232 items (at 0 items/min)
2026-03-30 13:06:58 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 13:06:58 [auto1.fr] INFO: Channel: 24h | Page: 148 | totalHits: 5956 | hits on page: 40
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS02300%27 HTTP/1.1" 200 None
2026-03-30 13:06:58 [auto1.fr] INFO: Scrape type for BS02300: 0
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ57976%27 HTTP/1.1" 200 None
2026-03-30 13:06:58 [auto1.fr] INFO: Scrape type for TZ57976: 0
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED20570%27 HTTP/1.1" 200 None
2026-03-30 13:06:58 [auto1.fr] INFO: Scrape type for ED20570: 0
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 13:06:58 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 13:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ79547%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for ZJ79547: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89018%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for CJ89018: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW62439%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for VW62439: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA20352%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for RA20352: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ77533%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for VJ77533: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE49273%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for WE49273: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL15544%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for UL15544: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX46626%27 HTTP/1.1" 200 None
2026-03-30 13:06:59 [auto1.fr] INFO: Scrape type for RX46626: 0
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 13:06:59 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 13:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:00 [auto1.fr] INFO: Channel: 24h | Page: 149 | totalHits: 5956 | hits on page: 36
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV75973%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for ZV75973: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ28528%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for LZ28528: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ96887%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for YJ96887: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE66924%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for GE66924: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ05514%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for JJ05514: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37914%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for UT37914: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV87266%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for VV87266: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ74891%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for AZ74891: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL17246%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for JL17246: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG41489%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for ZG41489: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA29891%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for MA29891: 0
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 13:07:00 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS63688%27 HTTP/1.1" 200 None
2026-03-30 13:07:00 [auto1.fr] INFO: Scrape type for LS63688: 0
2026-03-30 13:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 13:07:07 [auto1.fr] INFO: Channel: 24h | Page: 150 | totalHits: 5956 | hits on page: 0
2026-03-30 13:07:07 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 13:07:07 [auto1.fr] INFO: auto1.fr Batch config: batch 3/4
2026-03-30 13:07:07 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 82, <ScrapeType.BATCH_SKIPPED: 5>: 250}
2026-03-30 13:07:08 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (232 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_15_2026-03-30T11_10_00.jl
2026-03-30 13:07:08 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1585322,
'downloader/request_count': 803,
'downloader/request_method_count/GET': 650,
'downloader/request_method_count/POST': 153,
'downloader/response_bytes': 131503934,
'downloader/response_count': 803,
'downloader/response_status_count/200': 802,
'downloader/response_status_count/401': 1,
'dupefilter/filtered': 8,
'elapsed_time_seconds': 4269.024785,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 13, 7, 7, 931466, tzinfo=datetime.timezone.utc),
'item_scraped_count': 232,
'log_count/DEBUG': 9769,
'log_count/INFO': 13387,
'log_count/WARNING': 1,
'memusage/max': 181477376,
'memusage/startup': 149676032,
'photo_download_count': 447,
'request_depth_max': 155,
'response_received_count': 356,
'scheduler/dequeued': 803,
'scheduler/dequeued/memory': 803,
'scheduler/enqueued': 803,
'scheduler/enqueued/memory': 803,
'scrape_type/batch_skipped': 4497,
'scrape_type/new': 100,
'scrape_type/price_update': 132,
'scrape_type/skipped': 1259,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 418,
'scrapy-zyte-api/error_ratio': 0.14832535885167464,
'scrapy-zyte-api/errors': 62,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 62,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 12.116223982247543,
'scrapy-zyte-api/mean_response_seconds': 12.187491604052427,
'scrapy-zyte-api/processed': 356,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 356,
'scrapy-zyte-api/request_args/experimental.requestCookies': 355,
'scrapy-zyte-api/request_args/experimental.responseCookies': 356,
'scrapy-zyte-api/request_args/httpRequestBody': 153,
'scrapy-zyte-api/request_args/httpRequestMethod': 153,
'scrapy-zyte-api/request_args/httpResponseBody': 356,
'scrapy-zyte-api/request_args/httpResponseHeaders': 356,
'scrapy-zyte-api/request_args/sessionContext': 356,
'scrapy-zyte-api/request_args/url': 356,
'scrapy-zyte-api/status_codes/0': 62,
'scrapy-zyte-api/status_codes/200': 356,
'scrapy-zyte-api/success': 356,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 5996,
'source/total_available': 5956,
'start_time': datetime.datetime(2026, 3, 30, 11, 55, 58, 906681, tzinfo=datetime.timezone.utc)}
2026-03-30 13:07:08 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 13:07:08 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7287a16550>
2026-03-30 13:07:08 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7287a16990>